-- Logs begin at Mon 2022-07-25 04:49:34 UTC, end at Mon 2022-07-25 06:20:10 UTC. -- Jul 25 05:49:39.677443 dv-cinder-850831-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 05:49:39.686897 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 05:49:39.688827 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 05:49:39 2022] *** Jul 25 05:49:39.688827 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 05:49:39.688827 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 05:49:39.688827 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: nodename: dv-cinder-850831-1-iscsi Jul 25 05:49:39.688827 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: machine: x86_64 Jul 25 05:49:39.688827 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: clock source: unix Jul 25 05:49:39.688827 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: pcre jit disabled Jul 25 05:49:39.688827 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: detected number of CPU cores: 4 Jul 25 05:49:39.688827 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: current working directory: / Jul 25 05:49:39.688827 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: detected binary path: /usr/bin/uwsgi-core Jul 25 05:49:39.689507 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: your processes number limit is 47680 Jul 25 05:49:39.689507 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: your memory page size is 4096 bytes Jul 25 05:49:39.689507 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: detected max file descriptor number: 2048 Jul 25 05:49:39.689507 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: lock engine: pthread robust mutexes Jul 25 05:49:39.689507 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: thunder lock: enabled Jul 25 05:49:39.689507 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 05:49:39.689507 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 05:49:39.732544 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: Python main interpreter initialized at 0x558af941f9c0 Jul 25 05:49:39.732544 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: python threads support enabled Jul 25 05:49:39.732544 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: your server socket listen backlog is limited to 100 connections Jul 25 05:49:39.732544 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: your mercy for graceful operations on workers is 90 seconds Jul 25 05:49:39.732891 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 05:49:39.732973 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: *** Operational MODE: preforking *** Jul 25 05:49:39.733203 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: *** uWSGI is running in multiple interpreter mode *** Jul 25 05:49:39.733203 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: spawned uWSGI master process (pid: 115212) Jul 25 05:49:39.733389 dv-cinder-850831-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 05:49:39.733927 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: spawned uWSGI worker 1 (pid: 115213, cores: 1) Jul 25 05:49:39.735851 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: spawned uWSGI worker 2 (pid: 115214, cores: 1) Jul 25 05:49:39.735851 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 05:49:40.389193 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 05:49:40.389810 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 05:49:41.501160 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:49:41.501160 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: from cryptography.utils import int_from_bytes Jul 25 05:49:41.501792 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:49:41.501792 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: from cryptography.utils import int_from_bytes Jul 25 05:49:41.503729 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:49:41.503729 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: from cryptography.utils import int_from_bytes Jul 25 05:49:41.504162 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:49:41.504162 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: from cryptography.utils import int_from_bytes Jul 25 05:49:43.947124 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 05:49:43.947582 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 05:49:43.947890 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 05:49:43.948250 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 05:49:43.948500 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 05:49:43.948884 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.949731 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.950053 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.950364 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.950713 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.950926 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 05:49:43.951331 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.951419 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 05:49:43.951508 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.951625 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.951721 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 05:49:43.951945 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.952034 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 05:49:43.952200 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.952287 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 05:49:43.952507 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.952665 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.952825 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850831-1-iscsi {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.952997 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.953141 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.953321 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.953443 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.953643 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.953745 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.953975 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.954063 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.954286 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.954374 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.954639 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.954747 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.954948 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.955033 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.955279 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.955437 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.955555 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.956598 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.956744 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.956744 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.956948 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850831-1-iscsi {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.957040 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.957129 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.957210 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.957345 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.957436 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.957518 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.957606 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.957692 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.957771 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.957905 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.957996 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.958086 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.958252 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.958347 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.958578 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.958784 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.958969 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850831-1-iscsi {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.959097 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.959282 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.959405 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.959589 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.959716 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.959899 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.960053 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.960303 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.960394 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.960607 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.960702 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.960909 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.961003 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.961223 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.961317 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.961548 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.961643 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.961852 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.961958 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.962172 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.962262 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850831-1-iscsi {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.962493 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.962583 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.962824 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.962921 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.963139 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.963226 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.963437 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.963578 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.963740 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.963892 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.964042 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.964202 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.964353 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.964522 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.964651 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.965404 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.965495 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.965717 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.965802 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.966019 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.966107 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.966334 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.966433 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.966675 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.966773 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.966991 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.967090 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.967236 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.967326 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.967480 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.967651 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.967793 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.967881 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.968106 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.968196 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.968414 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.968517 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.968716 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.968803 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.969001 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.969086 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.969302 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.969402 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.969603 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.969691 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.969903 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.969989 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.970202 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.970298 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.970510 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.970614 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.970748 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.970837 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.971069 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.971164 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.971389 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.971476 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.971698 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.971794 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.972006 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.972104 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.972314 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.972410 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.972623 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.972718 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.972924 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.973016 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.973229 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.973314 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.973537 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.973632 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.973842 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.973929 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.974152 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.974237 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.974463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.974582 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.974799 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.974886 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.975101 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.975189 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.975405 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.975501 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.975718 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.975813 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.976036 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.976122 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.976335 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.976422 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.976580 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.976667 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.976875 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.976962 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.977175 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.977264 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.977486 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.977574 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.977785 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.977878 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.978083 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.978178 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.978388 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.978587 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.978705 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.978793 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.979004 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.979143 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.979302 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.979390 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.979600 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.979698 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.979899 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.979993 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.980195 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.980283 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.980519 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.980616 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.980819 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.980906 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.981119 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.981205 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.981418 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.981514 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.981722 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.981822 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.982023 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.982110 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.982321 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.982415 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.982645 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.982736 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.982946 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.983053 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.983244 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.983341 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.983548 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.983633 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.983846 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.983933 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.984145 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.984242 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.984448 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.984540 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.984747 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.984839 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.985045 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.985134 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.985354 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.985441 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.985654 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.985747 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.985951 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.986041 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.986253 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.986347 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.986567 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.986659 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.986868 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.986959 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.987178 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.987264 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.987477 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.987564 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.987776 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.987866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.988073 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.988173 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.988374 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.988461 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.988670 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.988758 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.988967 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.989054 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.989264 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.989351 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.989561 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.989649 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.989851 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.989946 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.990156 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.990255 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.990482 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.990621 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.990789 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.990878 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.991089 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.991187 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.991389 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.991486 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.991691 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.991776 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.991995 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.992097 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.992300 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.992395 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.992602 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.992699 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.992905 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.993001 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.993202 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.993291 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.993520 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.993615 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.993839 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.993930 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.994151 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.994239 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.994455 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.994591 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.994783 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.994917 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.995085 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.995180 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:43.995391 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.995478 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.995697 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.995786 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.996032 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.996120 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.996342 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.996442 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.996664 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.996753 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.996973 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.997068 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.997283 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.997379 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.997596 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.997690 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.997900 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.997995 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.998215 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.998312 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.998558 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.998651 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.998872 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.998972 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.999176 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.999313 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.999495 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.999589 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.999813 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:43.999901 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.000124 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.000258 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.000441 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.000529 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.000757 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.000843 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.001062 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.001157 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.001367 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.001456 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.001674 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.001766 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.001992 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.002090 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.002309 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.002401 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.002637 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.002727 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.002952 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.003042 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.003256 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.003357 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.003561 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.003648 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.003866 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.003961 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.004172 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.004259 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.004477 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.004571 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.004807 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.004903 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.005117 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.005208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.005427 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.005514 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.005734 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.005830 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.006047 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.006142 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.006357 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.006454 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.006691 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.006791 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.006999 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.007086 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.007301 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.007397 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.007603 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.007691 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.007905 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.008001 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.008217 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.008314 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.008519 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.008607 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.008833 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.008928 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.009144 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.009239 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.009449 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.009537 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.009763 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.009856 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.010064 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.010163 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.010375 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.010504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.010705 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.010832 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.011013 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.011104 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.011314 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.011400 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.012149 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.012255 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.012456 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.012543 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.012756 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.012851 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.013075 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.013170 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.013381 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.013470 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.013681 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.013774 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.013998 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.014095 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.014299 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.014386 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.014620 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.014712 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.014931 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.015037 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.015240 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.015329 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.015545 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.015632 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.015853 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.015956 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.016160 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.016255 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.016476 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.016562 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.016781 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.016946 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.017088 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.017175 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.017414 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.017502 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.017722 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.017815 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.018024 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.018120 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.018340 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.018428 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.018680 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.018771 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.018988 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.019074 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.019289 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.019376 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.019595 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.019684 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.019894 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.019989 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.020192 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.020279 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.020494 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.020596 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.020797 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.020890 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.021094 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.021190 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.021392 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.021479 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.021689 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.021776 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.021987 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.022083 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.022285 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.022380 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.022623 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.022715 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.022926 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.023045 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.023226 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.023328 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.023522 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.023610 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.023818 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.023915 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.024156 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.024252 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.024453 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.024542 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.024766 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.024854 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.025073 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.025161 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.025380 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.025468 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.025685 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.025774 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.025991 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.026077 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.026301 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.026388 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.026628 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.026730 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.026935 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.027021 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.027289 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.027926 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.028113 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.028205 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.028682 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.028777 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.028992 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.029079 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.029306 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.029401 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.029613 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.029700 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.029930 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.030027 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.030237 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.030324 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.030579 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.030694 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.030886 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.031004 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.031196 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.031284 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.031509 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.031604 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.031824 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.031921 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.032141 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.032229 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.032451 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.032538 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.032756 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.032859 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.033067 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.033162 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.033372 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.033472 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.033678 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.033773 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.033982 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.034070 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.034284 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.034371 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.034623 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.034712 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.034928 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.035013 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.035241 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.035371 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.035545 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.035641 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.035860 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.035948 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.036163 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.036250 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.036473 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.036561 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.036770 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.036863 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.037078 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.037173 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.037396 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.037485 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.037707 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.037794 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.038012 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.038106 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.038317 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.038412 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.038658 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.038746 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.038963 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.039066 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.039268 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.039356 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.039573 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.039660 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.039870 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.039968 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.040169 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.040257 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.040473 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.040561 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.040783 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.040892 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.041085 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.041174 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.041390 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.041477 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.041689 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.041778 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.041999 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.042093 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.042302 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.042390 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.042623 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.042723 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.042964 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.043056 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.043272 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.043359 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.043591 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.043679 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.043895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.043981 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.044209 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.044296 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.044523 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.044622 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.044819 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.044906 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.045115 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.045212 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.045430 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.045517 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.045733 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.045837 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.046031 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.046197 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.046327 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.046415 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.046650 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.046743 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.046974 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.047069 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.047278 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.047366 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.047577 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.047665 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.047888 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.047985 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.048196 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.048290 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.048500 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.048596 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.048815 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.048917 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.049119 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.049208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.049423 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.049511 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.049727 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.049814 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.050033 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.050111 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.050335 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.050418 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.050665 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.050749 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.050975 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.051065 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.051276 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.051353 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.051580 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.051669 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.051897 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.051986 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.052203 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.052299 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.052506 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.052607 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.052810 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.052897 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.053107 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.053208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.053411 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.053499 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.053721 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.053808 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.054034 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.054286 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.054374 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.054639 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.054743 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.054954 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.055049 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.055275 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.055363 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.055586 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.055680 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.055901 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.055996 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.056215 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.056309 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.056521 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.056608 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.056832 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.056927 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.057146 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.057246 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.057455 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.057709 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.057796 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.058045 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.058145 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.058353 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.058442 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.058707 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.058796 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.059007 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.059108 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.059310 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.059397 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.059616 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.059704 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.059914 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.060011 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.060213 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.060312 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.060513 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.060610 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.060812 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.060899 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.061123 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.061232 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.061420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.061512 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.061726 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.061814 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.062024 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.062114 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.062339 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.062441 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.062680 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.062784 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.062981 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.063069 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.063280 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.063367 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.063577 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.063674 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.063883 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.063971 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.064192 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.064291 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.064511 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.064609 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.064819 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.064917 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.065134 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.065222 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.065438 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.065538 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.065737 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.065825 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.066053 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.066141 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.066351 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.066440 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.066672 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.066764 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.066971 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.067058 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.067277 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.067366 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.067581 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.067668 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.067879 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.067966 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.068185 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.068274 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.068486 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.068575 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.068794 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.068882 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.069099 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.069195 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.069396 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.069484 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.069699 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.069868 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.069995 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.070139 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.070303 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.070399 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.070627 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.070735 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.070926 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.071014 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.071225 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.071332 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.071527 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.071628 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.071827 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.071924 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.072123 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.072213 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.072424 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.072527 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.072721 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.072809 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.073029 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.073117 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.073327 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.073416 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.073625 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.073712 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.073921 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.074017 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.074766 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.074858 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.075072 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.075160 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.075369 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.075457 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.075682 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.075817 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.075988 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.076076 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.076284 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.076371 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.076580 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.076675 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.076882 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.076970 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.077178 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.077275 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.077476 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.077564 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.077778 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.077864 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.078090 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.078186 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.078397 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.078503 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.078731 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.078831 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.079035 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.079132 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.079338 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.079426 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.079637 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.079723 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.079933 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.080030 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.080237 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.080325 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.080532 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.080627 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.080828 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.080925 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.081124 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.081229 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.081422 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.081547 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.081718 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.081816 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.082031 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.082119 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.082334 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.082422 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.082656 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.082747 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.082955 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.083050 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.083252 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.083348 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.083561 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.083649 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.083867 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.083955 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.084171 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.084266 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.084477 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.084565 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.084781 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.084869 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.085084 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.085181 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.085386 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.085472 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.085689 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.085776 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.085994 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.086090 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.086290 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.086378 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.086613 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.086705 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.086919 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.087018 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.087226 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.087313 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.087525 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.087612 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.087824 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.087913 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.088137 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.088225 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.088441 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.088529 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.088744 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.088841 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.089058 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.089146 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.089379 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.089466 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.089727 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.090315 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.090557 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.090646 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.090866 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.090953 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.091174 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.091264 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.091479 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.091564 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.091782 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.091871 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.092089 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.092177 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.092392 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.092486 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.092697 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.092798 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.093003 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.093091 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.093309 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.093398 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.093615 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.093712 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.093917 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.094006 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.094224 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.094312 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.094550 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.094661 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.094855 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.094950 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.095162 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.095248 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.095468 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.095564 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.095771 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.095866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.096077 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.096176 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.096379 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.096475 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.096684 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.096771 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.096982 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.097072 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.097287 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.097398 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.097599 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.097706 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.097912 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.097999 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.098218 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.098314 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.098566 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.098656 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.098882 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.098980 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.099190 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.099288 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.099502 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.099589 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.099800 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.099895 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.100111 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.100197 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.100419 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.100506 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.100800 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.100895 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.101107 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.101194 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.101406 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.101541 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.101706 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.101804 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.102012 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.102099 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.102329 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.102416 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.102669 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.102775 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.102969 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.103060 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.103268 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.103356 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.103586 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.103676 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.103886 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.103973 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.104203 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.104290 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.104582 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.104669 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.104889 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.104976 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.105193 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.105280 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.105533 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.105622 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.105860 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.105948 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.106166 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.106260 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.106537 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.106632 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.106800 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.106902 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.107124 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.107224 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.107429 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.107516 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.107735 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.107820 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.108041 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.108138 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.108359 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.108447 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.108676 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.108765 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.108983 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.109152 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.109299 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.109467 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.109601 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.109763 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.109916 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.110086 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.110233 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.110409 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.110564 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.110758 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.110882 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.111068 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.111288 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.111389 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.111608 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.111697 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.111915 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.112002 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.112231 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.112320 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.112554 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.112641 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.112857 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.112945 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.113158 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.113248 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.113464 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.113558 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.113765 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.113861 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.114067 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.114156 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.114383 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.114512 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.114711 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.114845 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.115022 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.115172 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.115331 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.115485 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.115638 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.115808 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.115938 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.116136 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.116225 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.116447 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.116535 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.116755 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.116852 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.117069 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.117164 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.117376 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.117465 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.117683 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.117773 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.118009 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.118097 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.118313 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.118399 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.118651 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.118740 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.118956 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.119043 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.119262 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.119363 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.119561 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.119650 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.119860 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.119956 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.120184 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.120281 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.120483 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.120578 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.120799 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.120890 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.121146 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.121243 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.121469 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.121557 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.121778 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.121867 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.122087 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.122186 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.122412 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.122536 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.122748 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.122837 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.123054 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.123214 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.123363 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.123452 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.123659 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.123746 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.123959 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.124056 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.124277 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.124375 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.124563 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.124659 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.124861 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.124951 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.125160 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.125250 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.125466 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.125555 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.125764 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.125854 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.126062 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.126158 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.126359 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.126462 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.126699 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.126801 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.126996 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.127120 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.127309 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.127416 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.127616 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.127744 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.127916 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.128013 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.128215 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.128314 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.128514 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.128612 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.128849 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.128937 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.129154 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.129244 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.129479 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.129575 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.129782 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.129869 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.130088 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.130177 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.130407 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.130537 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.130736 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.130825 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.131053 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.131154 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.131365 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.131453 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.131669 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.131763 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.131978 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.132112 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.132283 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.132372 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.132590 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.132677 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.132900 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.132989 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.133209 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.133298 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.133514 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.133610 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.133825 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.133913 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.134134 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.134222 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.134445 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.134613 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.134800 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.134973 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.135121 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.135297 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.135439 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.135605 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.135757 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.135912 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.136075 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.136221 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.136392 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.137035 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.137225 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.137356 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.137544 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.137664 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.137856 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.137968 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.138173 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.138262 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.138519 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.138612 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.138845 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.138937 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.139209 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.139360 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.139525 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.139693 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.139854 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.140012 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.140163 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.140327 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.140469 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.140643 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.140776 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.140959 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.141084 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.141281 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.141431 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.141597 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.141740 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.141913 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.142041 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.142226 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.142350 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.142566 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.142670 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.142901 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.142990 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.143226 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.143324 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.143552 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.143653 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.143859 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.143945 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.144165 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.144263 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.144472 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.144560 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.144775 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.144871 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.145081 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.145179 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.145387 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.145474 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.145704 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.145799 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.146033 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.146122 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.146348 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.146442 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.146682 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.146781 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.146992 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.147081 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.147304 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.147399 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.147617 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.147814 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.147933 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.148125 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.148247 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.148453 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.148544 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.148773 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.148870 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.149090 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.149178 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.149408 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.149534 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.149723 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.149820 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.150046 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.150135 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.150350 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.150447 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.150677 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.150780 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.150986 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.151082 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.151291 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.151389 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.151592 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.151842 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.151939 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.152181 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.152786 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.153030 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.153120 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.153345 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.153688 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.153907 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.153995 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.154230 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.154439 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.154608 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.154806 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.154895 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.155121 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.155211 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.155446 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.155534 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.155769 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.155857 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.156080 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.156169 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.156384 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.156470 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.156704 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.156798 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.157007 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.157101 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.157310 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.157400 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.157672 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.157768 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.157933 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.158023 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.158234 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.158463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.158607 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.158838 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.158936 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.159154 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.159241 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.159456 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.159544 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.159765 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.159855 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.160067 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.160161 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.160388 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.160476 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.160692 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.160781 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.160995 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.161123 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.161297 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.161395 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.161604 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.161692 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.161905 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.161993 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.162204 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.162301 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.162527 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.162620 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.162832 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.162920 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.163140 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.163242 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.163441 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.163529 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.163748 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.163836 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.164049 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.164146 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.164356 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.164445 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.164656 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.164744 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.164963 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.165058 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.165273 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.165369 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.165588 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.165676 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.165895 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.165985 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.166194 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.166281 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.166521 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.166610 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.166830 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.166924 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.167144 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.167231 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.167449 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.167537 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.167757 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.167847 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.168087 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.168174 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.168403 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.168493 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.168711 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.168931 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.169021 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.169264 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.169353 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.169580 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.169669 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.169906 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.169994 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.170232 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.170324 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.170562 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.170678 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.170868 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.170964 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.171172 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.171273 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.171490 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.171581 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.171797 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.171886 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.172103 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.172200 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.172408 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.172505 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.172718 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.172964 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.173053 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.173301 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.173390 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.173607 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.173694 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.173912 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.174000 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.174217 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.174306 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.174542 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.174634 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.174850 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.174939 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.175155 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.175245 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.175457 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.175547 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.175765 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.175863 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.176102 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.176188 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.176415 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.176504 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.176726 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.176869 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.177037 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.177125 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.177348 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.177434 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.177653 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.177752 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.177958 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.178046 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.178263 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.178359 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.178590 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.178694 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.178903 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.178994 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.179216 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.179310 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.179527 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.179616 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.179826 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.179915 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.180175 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.180262 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.180498 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.180586 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.180821 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.180909 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.181138 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.181237 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.181446 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.181535 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.181761 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.181849 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.182074 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.182169 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.182379 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.182466 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.182716 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.182803 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.183022 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.183122 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.183346 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.183434 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.183690 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.183776 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.184001 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.184091 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.184316 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.184402 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.184617 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.184727 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.184916 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.185054 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.185216 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.185378 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.185521 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.185694 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.185832 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.186019 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.186136 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.186345 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.186433 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.186686 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.186778 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.187012 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.187100 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.187321 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.187407 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.187619 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.187708 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.187916 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.188004 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.188211 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.188308 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.188512 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.188602 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.188807 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.188895 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.189106 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.189401 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.189495 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.189696 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.189785 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.189991 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.190090 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.190286 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.190398 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.190608 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.190733 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.190909 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.191043 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.191206 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.191363 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.191501 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.191672 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.191798 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.191980 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.192076 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.192289 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.192405 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.192596 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.192730 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.192909 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.193040 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.193216 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.193355 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.193523 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.193658 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.193830 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.193970 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.194137 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.194274 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.194445 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.194612 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.194773 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.194910 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.195086 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.195219 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.195393 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.195525 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.195702 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.195852 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.196009 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.196158 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.196318 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.196464 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.196625 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.196769 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.196958 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.197076 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.197293 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.197384 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.197613 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.197701 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.197939 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.198027 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.198255 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.198352 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.198604 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.198698 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.198921 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.199022 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.199760 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.199853 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.200080 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.200167 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.200394 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.200493 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.200701 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.200790 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.201027 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.201122 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.201333 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.201430 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.201638 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.201727 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.201946 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.202034 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.202254 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.202351 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.202584 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.202688 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.202897 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.202988 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.203203 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.203350 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.203509 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.203599 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.203819 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.203908 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.204133 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.204226 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.204453 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.204540 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.204772 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.204859 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.205080 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.205170 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.205392 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.205479 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.205712 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.205800 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.206024 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.206113 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.206337 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.206425 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.206673 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.206777 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.206989 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.207078 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.207302 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.207390 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.207609 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.207708 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.207911 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.207999 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.208148 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 05:49:44.208237 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.208525 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.208845 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.209174 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.209503 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.209817 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.210145 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.210516 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.210843 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.211163 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.211512 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.211849 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.212168 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.212485 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.212794 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:44.213038 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 05:49:44.269950 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO dbcounter [None req-20701a14-2478-40db-8dcf-25956c2baf45 None None] Registered counter for database nova_api Jul 25 05:49:44.275816 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO dbcounter [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] Registered counter for database nova_api Jul 25 05:49:44.381834 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG oslo_db.sqlalchemy.engines [None req-20701a14-2478-40db-8dcf-25956c2baf45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:49:44.386488 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_db.sqlalchemy.engines [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:49:44.388811 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG dbcounter [-] [115214] Writer thread running {{(pid=115214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:49:44.393335 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG dbcounter [-] [115213] Writer thread running {{(pid=115213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:49:44.450167 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.context [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e96e4b7c-deb5-4a1c-b19f-218c15ae3652(cell1) {{(pid=115213) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 05:49:44.451553 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.context [None req-20701a14-2478-40db-8dcf-25956c2baf45 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e96e4b7c-deb5-4a1c-b19f-218c15ae3652(cell1) {{(pid=115214) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 05:49:44.454061 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:44.455448 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG oslo_concurrency.lockutils [None req-20701a14-2478-40db-8dcf-25956c2baf45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:44.455711 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:44.456505 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:44.457032 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG oslo_concurrency.lockutils [None req-20701a14-2478-40db-8dcf-25956c2baf45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:44.457809 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG oslo_concurrency.lockutils [None req-20701a14-2478-40db-8dcf-25956c2baf45 None None] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:44.458653 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:44.459945 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG oslo_concurrency.lockutils [None req-20701a14-2478-40db-8dcf-25956c2baf45 None None] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:44.460639 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO dbcounter [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] Registered counter for database nova_cell0 Jul 25 05:49:44.461907 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO dbcounter [None req-20701a14-2478-40db-8dcf-25956c2baf45 None None] Registered counter for database nova_cell0 Jul 25 05:49:44.464460 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO dbcounter [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] Registered counter for database nova_cell1 Jul 25 05:49:44.466240 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO dbcounter [None req-20701a14-2478-40db-8dcf-25956c2baf45 None None] Registered counter for database nova_cell1 Jul 25 05:49:44.472444 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_db.sqlalchemy.engines [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:49:44.476867 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_db.sqlalchemy.engines [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:49:44.477019 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG oslo_db.sqlalchemy.engines [None req-20701a14-2478-40db-8dcf-25956c2baf45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:49:44.479162 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG oslo_db.sqlalchemy.engines [None req-20701a14-2478-40db-8dcf-25956c2baf45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:49:44.481532 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG dbcounter [-] [115213] Writer thread running {{(pid=115213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:49:44.481868 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG dbcounter [-] [115213] Writer thread running {{(pid=115213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:49:44.483982 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG dbcounter [-] [115214] Writer thread running {{(pid=115214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:49:44.489520 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG dbcounter [-] [115214] Writer thread running {{(pid=115214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:49:44.624091 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO dbcounter [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] Registered counter for database nova_cell0 Jul 25 05:49:44.631560 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO dbcounter [None req-20701a14-2478-40db-8dcf-25956c2baf45 None None] Registered counter for database nova_cell0 Jul 25 05:49:44.632703 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_db.sqlalchemy.engines [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:49:44.637551 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG dbcounter [-] [115213] Writer thread running {{(pid=115213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:49:44.639031 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG oslo_db.sqlalchemy.engines [None req-20701a14-2478-40db-8dcf-25956c2baf45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:49:44.643314 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG dbcounter [-] [115214] Writer thread running {{(pid=115214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:49:45.041740 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: WARNING keystonemiddleware.auth_token [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:49:45.049230 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: WARNING keystonemiddleware.auth_token [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:49:45.104228 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: WARNING keystonemiddleware.auth_token [None req-20701a14-2478-40db-8dcf-25956c2baf45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:49:45.111586 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: WARNING keystonemiddleware.auth_token [None req-20701a14-2478-40db-8dcf-25956c2baf45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:49:45.384216 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: WARNING keystonemiddleware.auth_token [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:49:45.391071 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: WARNING keystonemiddleware.auth_token [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:49:45.396459 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558af941f9c0 pid: 115213 (default app) Jul 25 05:49:45.398725 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:45.399936 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001928 Jul 25 05:49:45.400358 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Mon Jul 25 05:49:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:49:45.447707 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: WARNING keystonemiddleware.auth_token [None req-20701a14-2478-40db-8dcf-25956c2baf45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:49:45.454366 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: WARNING keystonemiddleware.auth_token [None req-20701a14-2478-40db-8dcf-25956c2baf45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:49:45.459583 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558af941f9c0 pid: 115214 (default app) Jul 25 05:51:04.100961 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:04.101968 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 25 05:51:04.102353 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 05:51:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:51:04.124313 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG dbcounter [-] [115214] Writing DB stats nova_api:SELECT=3 {{(pid=115214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:04.125697 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG dbcounter [-] [115214] Writing DB stats nova_cell0:SELECT=3 {{(pid=115214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:04.126920 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG dbcounter [-] [115214] Writing DB stats nova_cell1:SELECT=3 {{(pid=115214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:04.127941 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG dbcounter [-] [115214] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:04.993512 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-8c855c94-bca1-4c3f-b014-43048b033fc4 admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:05.024043 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-8c855c94-bca1-4c3f-b014-43048b033fc4 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.914243 Jul 25 05:51:05.024976 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1291 bytes} [Mon Jul 25 05:51:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:51:07.297569 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:07.299400 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-faada780-4530-4361-a4c2-293f8c8c8d23 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002228 Jul 25 05:51:07.299809 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 05:51:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:51:07.769865 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-1086b5f2-cb35-475f-a8ea-2d76815d27a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:07.780491 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:51:07.780491 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: warnings.warn(msg) Jul 25 05:51:07.861562 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-1086b5f2-cb35-475f-a8ea-2d76815d27a8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.555742 Jul 25 05:51:07.862552 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 05:51:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:51:08.079593 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-668c8052-54b8-42f3-a9f0-e4a234524f64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:08.081961 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:51:08.081961 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: warnings.warn(msg) Jul 25 05:51:08.084663 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG dbcounter [-] [115213] Writing DB stats nova_api:SELECT=3 {{(pid=115213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:08.085463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG dbcounter [-] [115213] Writing DB stats nova_cell0:SELECT=3 {{(pid=115213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:08.086216 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG dbcounter [-] [115213] Writing DB stats nova_cell1:SELECT=3 {{(pid=115213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:08.086837 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG dbcounter [-] [115213] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:08.200599 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-668c8052-54b8-42f3-a9f0-e4a234524f64 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.330163 Jul 25 05:51:08.201392 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1335 bytes} [Mon Jul 25 05:51:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:51:10.466143 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-1086b5f2-cb35-475f-a8ea-2d76815d27a8 admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:10.468314 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-1086b5f2-cb35-475f-a8ea-2d76815d27a8 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002611 Jul 25 05:51:10.471925 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 05:51:10 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:51:11.130230 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-4c8b88a0-2b27-4d49-8d37-9ce609d1cdf6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "id": "d1", "swap": 0, "disk": 5, "ram": 512}} {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:11.149575 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:51:11.149575 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: warnings.warn(msg) Jul 25 05:51:11.238039 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-4c8b88a0-2b27-4d49-8d37-9ce609d1cdf6 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.763112 Jul 25 05:51:11.238742 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 05:51:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:51:11.250907 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-5fc5a85e-a9f0-42ef-b8f5-35b10fdc50dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:11.252433 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:51:11.252433 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: warnings.warn(msg) Jul 25 05:51:11.337240 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-5fc5a85e-a9f0-42ef-b8f5-35b10fdc50dc admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090069 Jul 25 05:51:11.346497 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1335 bytes} [Mon Jul 25 05:51:11 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:51:13.582720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-4c8b88a0-2b27-4d49-8d37-9ce609d1cdf6 admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:13.583663 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-4c8b88a0-2b27-4d49-8d37-9ce609d1cdf6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jul 25 05:51:13.584056 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 05:51:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:51:13.976920 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-8367e388-5abe-4396-848d-0dfbd1c99944 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "disk": 10, "vcpus": 1}} {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:14.041435 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-8367e388-5abe-4396-848d-0dfbd1c99944 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.451777 Jul 25 05:51:14.041971 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 05:51:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 05:51:14.053992 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-4fa561a1-03e5-4329-b8fb-f9781956bc4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:14.142874 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-4fa561a1-03e5-4329-b8fb-f9781956bc4d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092452 Jul 25 05:51:14.143401 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1335 bytes} [Mon Jul 25 05:51:14 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:51:16.360524 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-8367e388-5abe-4396-848d-0dfbd1c99944 admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:16.361639 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-8367e388-5abe-4396-848d-0dfbd1c99944 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jul 25 05:51:16.362122 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 05:51:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:51:16.821325 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-90b7334c-3345-4ed0-a51a-9c18f6098d73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "id": "d3"}} {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:16.887135 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-90b7334c-3345-4ed0-a51a-9c18f6098d73 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.519030 Jul 25 05:51:16.887821 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 05:51:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:51:16.901442 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-5310bc97-e2ff-45c3-9231-30d74edb2615 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:16.988748 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-5310bc97-e2ff-45c3-9231-30d74edb2615 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090974 Jul 25 05:51:16.989677 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1335 bytes} [Mon Jul 25 05:51:16 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:51:19.216390 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-90b7334c-3345-4ed0-a51a-9c18f6098d73 admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:19.217420 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-90b7334c-3345-4ed0-a51a-9c18f6098d73 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 25 05:51:19.218071 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 05:51:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:51:19.667307 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-c77ba7cf-6d2e-46f2-b9d2-11ab8ac3d242 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "name": "ds4G", "rxtx_factor": 1.0}} {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:19.756227 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-c77ba7cf-6d2e-46f2-b9d2-11ab8ac3d242 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529807 Jul 25 05:51:19.756794 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 05:51:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:51:19.769480 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-0e7a9524-9aef-4b9d-b468-498cc9bb1d62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:19.915541 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-0e7a9524-9aef-4b9d-b468-498cc9bb1d62 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.149762 Jul 25 05:51:19.916495 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1335 bytes} [Mon Jul 25 05:51:19 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:51:22.150501 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-c77ba7cf-6d2e-46f2-b9d2-11ab8ac3d242 admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:22.151535 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-c77ba7cf-6d2e-46f2-b9d2-11ab8ac3d242 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 25 05:51:22.151943 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 05:51:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:51:22.595881 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-eb87ecfb-d13a-4fcc-afb5-95ddd6bfbda9 admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:22.618639 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-eb87ecfb-d13a-4fcc-afb5-95ddd6bfbda9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.460430 Jul 25 05:51:22.619191 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1291 bytes} [Mon Jul 25 05:51:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:51:25.606342 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-c77ba7cf-6d2e-46f2-b9d2-11ab8ac3d242 admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:25.607960 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-c77ba7cf-6d2e-46f2-b9d2-11ab8ac3d242 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002267 Jul 25 05:51:25.608548 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 05:51:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:51:26.063680 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-a786da05-d700-44fc-ae53-9830b77e3357 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "swap": 0, "vcpus": 1, "id": "1"}} {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:26.139134 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-a786da05-d700-44fc-ae53-9830b77e3357 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.522625 Jul 25 05:51:26.140179 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 05:51:25 2022] POST /compute/v2.1/flavors => generated 402 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:51:26.155004 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-9d02a7a4-9088-4a47-a828-8844a7fef6f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:26.235129 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-9d02a7a4-9088-4a47-a828-8844a7fef6f0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085439 Jul 25 05:51:26.235734 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1332 bytes} [Mon Jul 25 05:51:26 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:51:28.439059 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-a786da05-d700-44fc-ae53-9830b77e3357 admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:28.440008 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-a786da05-d700-44fc-ae53-9830b77e3357 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 25 05:51:28.440399 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 05:51:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:51:28.848913 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-5401501b-315b-4c65-b135-607e06b76f2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small", "vcpus": 1, "swap": 0, "disk": 20, "id": "2", "ram": 2048}} {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:28.904730 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-5401501b-315b-4c65-b135-607e06b76f2c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.458473 Jul 25 05:51:28.905284 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 05:51:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:51:28.917795 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-9a2e1f6f-547f-4e46-b3e9-f3b7a5bf3feb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:28.964626 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-9a2e1f6f-547f-4e46-b3e9-f3b7a5bf3feb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050579 Jul 25 05:51:28.965196 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1332 bytes} [Mon Jul 25 05:51:28 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:51:31.196470 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-5401501b-315b-4c65-b135-607e06b76f2c admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:31.197496 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-5401501b-315b-4c65-b135-607e06b76f2c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 25 05:51:31.198165 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 05:51:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:51:31.642701 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-92392e05-a8e7-4d46-819e-1c43f179c5de admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:31.711643 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-92392e05-a8e7-4d46-819e-1c43f179c5de admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.507147 Jul 25 05:51:31.714604 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 05:51:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:51:31.724669 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-1b55f8d1-bd3c-4d41-b631-4498e34e1acc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:31.822935 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-1b55f8d1-bd3c-4d41-b631-4498e34e1acc admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101955 Jul 25 05:51:31.823625 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1332 bytes} [Mon Jul 25 05:51:31 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:51:34.095710 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-92392e05-a8e7-4d46-819e-1c43f179c5de admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:34.096723 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-92392e05-a8e7-4d46-819e-1c43f179c5de admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 25 05:51:34.097327 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 05:51:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:51:34.540895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-b7999bb7-c4e5-4a3a-98e7-aef482666987 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "disk": 80, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:34.545602 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG dbcounter [-] [115214] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=115214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:34.648474 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-b7999bb7-c4e5-4a3a-98e7-aef482666987 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.545351 Jul 25 05:51:34.649364 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 05:51:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:51:34.661186 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-e098c80a-6f2f-4140-867f-c6e22230585e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:34.769374 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-e098c80a-6f2f-4140-867f-c6e22230585e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111830 Jul 25 05:51:34.769968 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1332 bytes} [Mon Jul 25 05:51:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:51:37.076588 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-b7999bb7-c4e5-4a3a-98e7-aef482666987 admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:37.078329 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-b7999bb7-c4e5-4a3a-98e7-aef482666987 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002659 Jul 25 05:51:37.079268 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 05:51:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:51:37.578868 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-5431ed2b-5989-4c7f-b231-7417f996e39e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384}} {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:38.355855 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-5431ed2b-5989-4c7f-b231-7417f996e39e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 1.269008 Jul 25 05:51:38.356545 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 05:51:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:51:38.371447 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-eb72ea65-a20a-4e5b-8061-cc9f1db5cefd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:51:38.469877 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-eb72ea65-a20a-4e5b-8061-cc9f1db5cefd admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104160 Jul 25 05:51:38.491154 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1332 bytes} [Mon Jul 25 05:51:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:51:57.856286 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-5431ed2b-5989-4c7f-b231-7417f996e39e admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:57.857276 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-5431ed2b-5989-4c7f-b231-7417f996e39e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jul 25 05:51:57.857660 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 05:51:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:51:58.240411 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-c25542a8-9262-4212-8959-d026e9e5e22c admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:58.257450 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-c25542a8-9262-4212-8959-d026e9e5e22c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.394021 Jul 25 05:51:58.257971 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1291 bytes} [Mon Jul 25 05:51:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:51:59.317480 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-5431ed2b-5989-4c7f-b231-7417f996e39e admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:59.318503 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-5431ed2b-5989-4c7f-b231-7417f996e39e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 25 05:51:59.318898 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 05:51:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:51:59.836510 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-4f8cc31a-2756-4ffc-8d04-91a25c994841 admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:59.842703 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.wsgi [None req-4f8cc31a-2756-4ffc-8d04-91a25c994841 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-4f8cc31a-2756-4ffc-8d04-91a25c994841 admin admin] Request method failure captured: Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Accept: application/json Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Accept-Encoding: gzip, deflate Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Connection: keep-alive Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Content-Length: 0 Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Host: 10.222.0.17 Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Openstack-Api-Version: compute 2.90 Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Openstack-System-Scope: None Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: User-Agent: python-novaclient Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Auth-Token: gAAAAABi3i9_hgMuXP44IicJ_yqVdT0aAfvMbh4IllOywMjhP1k4A8PKsGcf7xoahTw-cPl_B1GdQdlUw1WgAUOStm7hC1w28xuT_r8m5G7ktLTH-8294-SG7aEMBvwv-CKSlDGpYjpWP4_WQTec4mzc5R0TFs_uvG7A3sv3jDPbGZ6IEbx6g4c Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Domain-Id: None Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Domain-Name: None Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Identity-Status: Confirmed Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Is-Admin-Project: True Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Project-Domain-Id: default Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Project-Domain-Name: Default Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Project-Id: 799d47101892496a8efa7ee2b0f5f24a Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Project-Name: admin Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Role: reader,admin,member Jul 25 05:51:59.845895 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Roles: reader,admin,member Jul 25 05:51:59.847586 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_799d47101892496a8efa7ee2b0f5f24a", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 05:51:59.847586 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Tenant: admin Jul 25 05:51:59.847586 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Tenant-Id: 799d47101892496a8efa7ee2b0f5f24a Jul 25 05:51:59.847586 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Tenant-Name: admin Jul 25 05:51:59.847586 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-User: admin Jul 25 05:51:59.847586 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-User-Domain-Id: default Jul 25 05:51:59.847586 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-User-Domain-Name: Default Jul 25 05:51:59.847586 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-User-Id: 16be6f6629504bf5b97a9530841ecf24 Jul 25 05:51:59.847586 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-User-Name: admin Jul 25 05:51:59.847586 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: method: > Jul 25 05:51:59.847586 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: exception: Flavor 42 could not be found. Jul 25 05:51:59.847586 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: action_args: {'id': '42'} Jul 25 05:51:59.847586 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:51:59.847586 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:51:59.848652 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Jul 25 05:51:59.850065 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-4f8cc31a-2756-4ffc-8d04-91a25c994841 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115214) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:51:59.851575 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-4f8cc31a-2756-4ffc-8d04-91a25c994841 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.391786 Jul 25 05:51:59.851575 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Mon Jul 25 05:51:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 25 05:51:59.856812 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-69fbd3b5-a9a9-4b7e-9987-ea88c8fc2559 admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:59.859645 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG dbcounter [-] [115213] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:59.877652 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-69fbd3b5-a9a9-4b7e-9987-ea88c8fc2559 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024328 Jul 25 05:51:59.878120 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Jul 25 05:51:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:51:59.887704 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-29355832-afcb-468a-8e64-09388c44e5fa admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:59.909988 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-29355832-afcb-468a-8e64-09388c44e5fa admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025799 Jul 25 05:51:59.910556 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Jul 25 05:51:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:51:59.920188 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-41d872f6-4b21-4ced-b909-2e1595b5ed00 admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:59.925891 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.wsgi [None req-41d872f6-4b21-4ced-b909-2e1595b5ed00 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-41d872f6-4b21-4ced-b909-2e1595b5ed00 admin admin] Request method failure captured: Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Accept: application/json Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Accept-Encoding: gzip, deflate Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Connection: keep-alive Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Content-Length: 0 Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Host: 10.222.0.17 Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Openstack-Api-Version: compute 2.90 Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Openstack-System-Scope: None Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: User-Agent: python-novaclient Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Auth-Token: gAAAAABi3i9_hgMuXP44IicJ_yqVdT0aAfvMbh4IllOywMjhP1k4A8PKsGcf7xoahTw-cPl_B1GdQdlUw1WgAUOStm7hC1w28xuT_r8m5G7ktLTH-8294-SG7aEMBvwv-CKSlDGpYjpWP4_WQTec4mzc5R0TFs_uvG7A3sv3jDPbGZ6IEbx6g4c Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Domain-Id: None Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Domain-Name: None Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Identity-Status: Confirmed Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Is-Admin-Project: True Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Project-Domain-Id: default Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Project-Domain-Name: Default Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Project-Id: 799d47101892496a8efa7ee2b0f5f24a Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Project-Name: admin Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Role: reader,admin,member Jul 25 05:51:59.930866 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Roles: reader,admin,member Jul 25 05:51:59.932404 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_799d47101892496a8efa7ee2b0f5f24a", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 05:51:59.932404 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Tenant: admin Jul 25 05:51:59.932404 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Tenant-Id: 799d47101892496a8efa7ee2b0f5f24a Jul 25 05:51:59.932404 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Tenant-Name: admin Jul 25 05:51:59.932404 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-User: admin Jul 25 05:51:59.932404 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-User-Domain-Id: default Jul 25 05:51:59.932404 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-User-Domain-Name: Default Jul 25 05:51:59.932404 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-User-Id: 16be6f6629504bf5b97a9530841ecf24 Jul 25 05:51:59.932404 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-User-Name: admin Jul 25 05:51:59.932404 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: method: > Jul 25 05:51:59.932404 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: exception: Flavor 42 could not be found. Jul 25 05:51:59.932404 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: action_args: {'id': '42'} Jul 25 05:51:59.932404 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:51:59.932404 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:51:59.933504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Jul 25 05:51:59.935463 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-41d872f6-4b21-4ced-b909-2e1595b5ed00 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:51:59.936721 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-41d872f6-4b21-4ced-b909-2e1595b5ed00 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014241 Jul 25 05:51:59.936721 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Mon Jul 25 05:51:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 25 05:52:00.905109 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-29355832-afcb-468a-8e64-09388c44e5fa admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:00.906731 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-29355832-afcb-468a-8e64-09388c44e5fa admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 25 05:52:00.906731 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 05:52:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:01.421870 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-7478407e-755c-45a2-bfe2-b77a66902e90 admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:01.427739 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.wsgi [None req-7478407e-755c-45a2-bfe2-b77a66902e90 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-7478407e-755c-45a2-bfe2-b77a66902e90 admin admin] Request method failure captured: Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Accept: application/json Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Accept-Encoding: gzip, deflate Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Connection: keep-alive Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Content-Length: 0 Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Host: 10.222.0.17 Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Openstack-Api-Version: compute 2.90 Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Openstack-System-Scope: None Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: User-Agent: python-novaclient Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Auth-Token: gAAAAABi3i-Ad6HdUzl5EuR0ZoQl0mMVm7t8B8O3bwxhAefYi9AM5B_bn6EVGOwQGCfBwrifIT2peY-h4hDmgr4H_JI51TBtZxibU0p1VVm9guXQJdEPH64Ok9-xjSJ7u-MqrfIh-unl8W_Bofb8FSJVcVhkbQntf_V8QBYre6pSGqCOjlPb8Do Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Domain-Id: None Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Domain-Name: None Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Identity-Status: Confirmed Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Is-Admin-Project: True Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Project-Domain-Id: default Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Project-Domain-Name: Default Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Project-Id: 799d47101892496a8efa7ee2b0f5f24a Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Project-Name: admin Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Role: reader,admin,member Jul 25 05:52:01.429243 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Roles: reader,admin,member Jul 25 05:52:01.430856 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_799d47101892496a8efa7ee2b0f5f24a", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 05:52:01.430856 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Tenant: admin Jul 25 05:52:01.430856 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Tenant-Id: 799d47101892496a8efa7ee2b0f5f24a Jul 25 05:52:01.430856 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Tenant-Name: admin Jul 25 05:52:01.430856 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-User: admin Jul 25 05:52:01.430856 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-User-Domain-Id: default Jul 25 05:52:01.430856 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-User-Domain-Name: Default Jul 25 05:52:01.430856 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-User-Id: 16be6f6629504bf5b97a9530841ecf24 Jul 25 05:52:01.430856 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-User-Name: admin Jul 25 05:52:01.430856 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: method: > Jul 25 05:52:01.430856 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: exception: Flavor 84 could not be found. Jul 25 05:52:01.430856 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: action_args: {'id': '84'} Jul 25 05:52:01.430856 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:52:01.430856 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:01.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Jul 25 05:52:01.432894 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-7478407e-755c-45a2-bfe2-b77a66902e90 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:52:01.434123 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-7478407e-755c-45a2-bfe2-b77a66902e90 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.384562 Jul 25 05:52:01.434123 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Mon Jul 25 05:52:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:01.440892 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-10fb3fe1-7da7-4f6f-9c0d-74d79d9881ac admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:01.455024 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-10fb3fe1-7da7-4f6f-9c0d-74d79d9881ac admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017590 Jul 25 05:52:01.455540 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Jul 25 05:52:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:52:01.464474 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-40ffa75c-17e3-4c61-b347-adf4fd0499ee admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:01.477697 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-40ffa75c-17e3-4c61-b347-adf4fd0499ee admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016603 Jul 25 05:52:01.478225 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Jul 25 05:52:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:52:01.486758 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-10a8e348-2cbd-4e96-9a6f-a08193600672 admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:01.491886 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.wsgi [None req-10a8e348-2cbd-4e96-9a6f-a08193600672 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-10a8e348-2cbd-4e96-9a6f-a08193600672 admin admin] Request method failure captured: Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Accept: application/json Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Accept-Encoding: gzip, deflate Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Connection: keep-alive Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Content-Length: 0 Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Host: 10.222.0.17 Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Openstack-Api-Version: compute 2.90 Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Openstack-System-Scope: None Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: User-Agent: python-novaclient Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Auth-Token: gAAAAABi3i-Ad6HdUzl5EuR0ZoQl0mMVm7t8B8O3bwxhAefYi9AM5B_bn6EVGOwQGCfBwrifIT2peY-h4hDmgr4H_JI51TBtZxibU0p1VVm9guXQJdEPH64Ok9-xjSJ7u-MqrfIh-unl8W_Bofb8FSJVcVhkbQntf_V8QBYre6pSGqCOjlPb8Do Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Domain-Id: None Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Domain-Name: None Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Identity-Status: Confirmed Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Is-Admin-Project: True Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Project-Domain-Id: default Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Project-Domain-Name: Default Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Project-Id: 799d47101892496a8efa7ee2b0f5f24a Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Project-Name: admin Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Role: reader,admin,member Jul 25 05:52:01.493373 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Roles: reader,admin,member Jul 25 05:52:01.495039 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_799d47101892496a8efa7ee2b0f5f24a", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 05:52:01.495039 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Tenant: admin Jul 25 05:52:01.495039 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Tenant-Id: 799d47101892496a8efa7ee2b0f5f24a Jul 25 05:52:01.495039 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Tenant-Name: admin Jul 25 05:52:01.495039 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-User: admin Jul 25 05:52:01.495039 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-User-Domain-Id: default Jul 25 05:52:01.495039 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-User-Domain-Name: Default Jul 25 05:52:01.495039 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-User-Id: 16be6f6629504bf5b97a9530841ecf24 Jul 25 05:52:01.495039 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-User-Name: admin Jul 25 05:52:01.495039 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: method: > Jul 25 05:52:01.495039 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: exception: Flavor 84 could not be found. Jul 25 05:52:01.495039 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: action_args: {'id': '84'} Jul 25 05:52:01.495039 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:52:01.495039 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:01.496191 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Jul 25 05:52:01.498038 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-10a8e348-2cbd-4e96-9a6f-a08193600672 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115214) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:52:01.499349 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-10a8e348-2cbd-4e96-9a6f-a08193600672 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011302 Jul 25 05:52:01.499349 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Mon Jul 25 05:52:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 25 05:52:02.465366 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-40ffa75c-17e3-4c61-b347-adf4fd0499ee admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:02.466912 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-40ffa75c-17e3-4c61-b347-adf4fd0499ee admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 25 05:52:02.467334 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 05:52:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:03.095282 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-71e09d74-6f5f-42ea-9d3b-f62c015dab18 admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:03.100953 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.wsgi [None req-71e09d74-6f5f-42ea-9d3b-f62c015dab18 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-71e09d74-6f5f-42ea-9d3b-f62c015dab18 admin admin] Request method failure captured: Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Accept: application/json Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Accept-Encoding: gzip, deflate Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Connection: keep-alive Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Content-Length: 0 Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Host: 10.222.0.17 Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Openstack-Api-Version: compute 2.90 Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Openstack-System-Scope: None Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: User-Agent: python-novaclient Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Auth-Token: gAAAAABi3i-COiS6vq45_bbKlUGKpPeIOyewcCMTlJOBbOrH3E7_dW4cR3rEMs_Hyx_QOR6x1REHE8IL8Mh0R0LYPXlXowSLHZ_xvn9xoC5-Nw-Deiutib_6oBo338z5W7rt8aOAm1dBDgYUTTxl03SP6FPoEBCPw-4CIScGwUCK9FpfVozkQDg Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Domain-Id: None Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Domain-Name: None Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Identity-Status: Confirmed Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Is-Admin-Project: True Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Project-Domain-Id: default Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Project-Domain-Name: Default Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Project-Id: 799d47101892496a8efa7ee2b0f5f24a Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Project-Name: admin Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Role: reader,admin,member Jul 25 05:52:03.102420 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Roles: reader,admin,member Jul 25 05:52:03.104004 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_799d47101892496a8efa7ee2b0f5f24a", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 05:52:03.104004 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Tenant: admin Jul 25 05:52:03.104004 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Tenant-Id: 799d47101892496a8efa7ee2b0f5f24a Jul 25 05:52:03.104004 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-Tenant-Name: admin Jul 25 05:52:03.104004 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-User: admin Jul 25 05:52:03.104004 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-User-Domain-Id: default Jul 25 05:52:03.104004 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-User-Domain-Name: Default Jul 25 05:52:03.104004 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-User-Id: 16be6f6629504bf5b97a9530841ecf24 Jul 25 05:52:03.104004 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: X-User-Name: admin Jul 25 05:52:03.104004 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: method: > Jul 25 05:52:03.104004 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: exception: Flavor 451 could not be found. Jul 25 05:52:03.104004 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: action_args: {'id': '451'} Jul 25 05:52:03.104004 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:52:03.104004 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:03.104839 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: ERROR nova.api.openstack.wsgi Jul 25 05:52:03.106400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-71e09d74-6f5f-42ea-9d3b-f62c015dab18 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115214) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:52:03.107563 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-71e09d74-6f5f-42ea-9d3b-f62c015dab18 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.500489 Jul 25 05:52:03.107563 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Jul 25 05:52:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 502 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:03.113594 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-fc7c5624-68b6-4aa5-85f1-1eb67276e5ca admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:03.127729 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-fc7c5624-68b6-4aa5-85f1-1eb67276e5ca admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017618 Jul 25 05:52:03.128195 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Jul 25 05:52:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:52:03.137531 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-dc39d139-c3a2-4f4e-96b4-650823f4306c admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:03.152690 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-dc39d139-c3a2-4f4e-96b4-650823f4306c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018650 Jul 25 05:52:03.153212 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Jul 25 05:52:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:52:03.162823 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-e4973d4c-416c-4dd3-9e03-1fb0b5694285 admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:03.168137 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.wsgi [None req-e4973d4c-416c-4dd3-9e03-1fb0b5694285 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-e4973d4c-416c-4dd3-9e03-1fb0b5694285 admin admin] Request method failure captured: Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Accept: application/json Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Accept-Encoding: gzip, deflate Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Connection: keep-alive Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Content-Length: 0 Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Host: 10.222.0.17 Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Openstack-Api-Version: compute 2.90 Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Openstack-System-Scope: None Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: User-Agent: python-novaclient Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Auth-Token: gAAAAABi3i-COiS6vq45_bbKlUGKpPeIOyewcCMTlJOBbOrH3E7_dW4cR3rEMs_Hyx_QOR6x1REHE8IL8Mh0R0LYPXlXowSLHZ_xvn9xoC5-Nw-Deiutib_6oBo338z5W7rt8aOAm1dBDgYUTTxl03SP6FPoEBCPw-4CIScGwUCK9FpfVozkQDg Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Domain-Id: None Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Domain-Name: None Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Identity-Status: Confirmed Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Is-Admin-Project: True Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Project-Domain-Id: default Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Project-Domain-Name: Default Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Project-Id: 799d47101892496a8efa7ee2b0f5f24a Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Project-Name: admin Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Role: reader,admin,member Jul 25 05:52:03.169640 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Roles: reader,admin,member Jul 25 05:52:03.171219 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/799d47101892496a8efa7ee2b0f5f24a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_799d47101892496a8efa7ee2b0f5f24a", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 05:52:03.171219 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Tenant: admin Jul 25 05:52:03.171219 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Tenant-Id: 799d47101892496a8efa7ee2b0f5f24a Jul 25 05:52:03.171219 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-Tenant-Name: admin Jul 25 05:52:03.171219 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-User: admin Jul 25 05:52:03.171219 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-User-Domain-Id: default Jul 25 05:52:03.171219 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-User-Domain-Name: Default Jul 25 05:52:03.171219 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-User-Id: 16be6f6629504bf5b97a9530841ecf24 Jul 25 05:52:03.171219 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: X-User-Name: admin Jul 25 05:52:03.171219 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: method: > Jul 25 05:52:03.171219 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: exception: Flavor 451 could not be found. Jul 25 05:52:03.171219 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: action_args: {'id': '451'} Jul 25 05:52:03.171219 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:52:03.171219 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:03.172208 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: ERROR nova.api.openstack.wsgi Jul 25 05:52:03.173284 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-e4973d4c-416c-4dd3-9e03-1fb0b5694285 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:52:03.174293 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-e4973d4c-416c-4dd3-9e03-1fb0b5694285 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011738 Jul 25 05:52:03.174293 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Jul 25 05:52:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:04.139415 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-dc39d139-c3a2-4f4e-96b4-650823f4306c admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:04.140430 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-dc39d139-c3a2-4f4e-96b4-650823f4306c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 25 05:52:04.140823 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 05:52:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:04.658285 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-63371d72-f28b-4e5c-8cd1-bc7b20221221 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:04.726574 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-63371d72-f28b-4e5c-8cd1-bc7b20221221 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.446461 Jul 25 05:52:04.727119 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Mon Jul 25 05:52:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:05.689732 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-dc39d139-c3a2-4f4e-96b4-650823f4306c admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:05.690787 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-dc39d139-c3a2-4f4e-96b4-650823f4306c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 25 05:52:05.691177 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 05:52:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:06.209727 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-ae40b0b6-e77c-4757-b28e-bbc31465861e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:06.280622 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-ae40b0b6-e77c-4757-b28e-bbc31465861e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.451655 Jul 25 05:52:06.281160 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Mon Jul 25 05:52:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:07.254283 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-dc39d139-c3a2-4f4e-96b4-650823f4306c admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:07.255345 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-dc39d139-c3a2-4f4e-96b4-650823f4306c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 25 05:52:07.255741 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 05:52:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:07.783720 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-79145951-2d1d-493e-81b8-1aa5e85234c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:07.869140 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-79145951-2d1d-493e-81b8-1aa5e85234c9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.474181 Jul 25 05:52:07.869683 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Mon Jul 25 05:52:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:08.849789 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-dc39d139-c3a2-4f4e-96b4-650823f4306c admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:08.850817 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-dc39d139-c3a2-4f4e-96b4-650823f4306c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 25 05:52:08.851212 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 05:52:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:09.367512 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-8ec2fb7b-b948-4b20-83db-ea89f5739d3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:09.435404 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-8ec2fb7b-b948-4b20-83db-ea89f5739d3d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.443723 Jul 25 05:52:09.435948 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Mon Jul 25 05:52:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:10.414264 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-dc39d139-c3a2-4f4e-96b4-650823f4306c admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:10.415294 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-dc39d139-c3a2-4f4e-96b4-650823f4306c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 25 05:52:10.415687 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 05:52:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:10.943477 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-a0ee043e-5447-453a-ad98-641b3bacef18 admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:10.962181 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-a0ee043e-5447-453a-ad98-641b3bacef18 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.412077 Jul 25 05:52:10.962743 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Mon Jul 25 05:52:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:53:03.314816 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-dc39d139-c3a2-4f4e-96b4-650823f4306c admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:53:03.315822 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-dc39d139-c3a2-4f4e-96b4-650823f4306c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 25 05:53:03.316214 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 05:53:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:53:03.326985 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG dbcounter [-] [115213] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:53:03.702984 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-1521c1a7-9e75-4f55-bec4-a11cdc77b0e4 admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:53:03.721890 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-1521c1a7-9e75-4f55-bec4-a11cdc77b0e4 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.399824 Jul 25 05:53:03.722504 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1291 bytes} [Mon Jul 25 05:53:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:53:03.744915 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG dbcounter [-] [115214] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=115214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:53:03.747040 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-b12775f8-6163-45f5-9fbe-8d31bbd678f3 admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:53:03.754532 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-b12775f8-6163-45f5-9fbe-8d31bbd678f3 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013051 Jul 25 05:53:03.755069 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1282 bytes} [Mon Jul 25 05:53:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:53:03.767133 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-d06fcf40-e287-4479-bcca-19f353d90a67 admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:53:03.774809 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-d06fcf40-e287-4479-bcca-19f353d90a67 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011171 Jul 25 05:53:03.775301 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1285 bytes} [Mon Jul 25 05:53:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:53:03.786614 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-c54d129d-7604-45db-b705-46d376a04ad6 admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:53:03.794432 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-c54d129d-7604-45db-b705-46d376a04ad6 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011615 Jul 25 05:53:03.794973 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1285 bytes} [Mon Jul 25 05:53:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:53:03.805824 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-4a19df0c-f618-430d-89e5-d2be3fe08473 admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:53:03.813991 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-4a19df0c-f618-430d-89e5-d2be3fe08473 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011667 Jul 25 05:53:03.814589 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1282 bytes} [Mon Jul 25 05:53:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:56:34.288836 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-c54d129d-7604-45db-b705-46d376a04ad6 admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:56:34.289856 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-c54d129d-7604-45db-b705-46d376a04ad6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 25 05:56:34.290252 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 05:56:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:56:34.435567 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG dbcounter [-] [115213] Writing DB stats nova_api:SELECT=6 {{(pid=115213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:34.589169 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-470f1303-ca6a-4062-a6ba-19417887ac95 admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:56:34.591110 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:56:34.591110 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: warnings.warn(msg) Jul 25 05:56:34.592321 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-470f1303-ca6a-4062-a6ba-19417887ac95 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:56:34.592755 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-470f1303-ca6a-4062-a6ba-19417887ac95 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:56:34.593530 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-470f1303-ca6a-4062-a6ba-19417887ac95 admin admin] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:56:34.593971 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-470f1303-ca6a-4062-a6ba-19417887ac95 admin admin] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:56:34.631523 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-470f1303-ca6a-4062-a6ba-19417887ac95 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.203345 Jul 25 05:56:34.632159 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Jul 25 05:56:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:56:35.457647 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-c54d129d-7604-45db-b705-46d376a04ad6 admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:56:35.458682 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-c54d129d-7604-45db-b705-46d376a04ad6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 25 05:56:35.459076 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 05:56:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:56:35.649834 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-daa68661-ac6e-4949-b539-256ebdcac753 admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:56:35.651117 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:56:35.651117 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: warnings.warn(msg) Jul 25 05:56:35.652361 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-daa68661-ac6e-4949-b539-256ebdcac753 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:56:35.652801 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-daa68661-ac6e-4949-b539-256ebdcac753 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:56:35.653604 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-daa68661-ac6e-4949-b539-256ebdcac753 admin admin] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:56:35.654035 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-daa68661-ac6e-4949-b539-256ebdcac753 admin admin] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:56:35.673655 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-daa68661-ac6e-4949-b539-256ebdcac753 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075812 Jul 25 05:56:35.674142 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Jul 25 05:56:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:56:46.884027 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-c54d129d-7604-45db-b705-46d376a04ad6 admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:56:46.885037 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-c54d129d-7604-45db-b705-46d376a04ad6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 25 05:56:46.885427 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 05:56:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:56:47.028607 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG dbcounter [-] [115213] Writing DB stats nova_cell0:SELECT=4 {{(pid=115213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:47.029321 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG dbcounter [-] [115213] Writing DB stats nova_cell1:SELECT=4 {{(pid=115213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:47.029933 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG dbcounter [-] [115213] Writing DB stats nova_api:SELECT=8 {{(pid=115213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:47.083695 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-18080c1e-9f79-49b2-b2fa-d65f612d3102 admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:56:47.084859 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:56:47.084859 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: warnings.warn(msg) Jul 25 05:56:47.086035 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-18080c1e-9f79-49b2-b2fa-d65f612d3102 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:56:47.086483 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-18080c1e-9f79-49b2-b2fa-d65f612d3102 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:56:47.087256 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-18080c1e-9f79-49b2-b2fa-d65f612d3102 admin admin] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:56:47.087678 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-18080c1e-9f79-49b2-b2fa-d65f612d3102 admin admin] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:56:47.113497 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-18080c1e-9f79-49b2-b2fa-d65f612d3102 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089247 Jul 25 05:56:47.114281 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Jul 25 05:56:47 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:56:47.945956 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: DEBUG nova.api.openstack.wsgi [None req-c54d129d-7604-45db-b705-46d376a04ad6 admin admin] Calling method '>' {{(pid=115214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:56:47.947001 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: INFO nova.api.openstack.requestlog [None req-c54d129d-7604-45db-b705-46d376a04ad6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 25 05:56:47.947400 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: [pid: 115214|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 05:56:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:56:48.136815 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG nova.api.openstack.wsgi [None req-baa8da67-ad40-4a60-985b-b4986f5c5186 admin admin] Calling method '>' {{(pid=115213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:56:48.138012 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:56:48.138012 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: warnings.warn(msg) Jul 25 05:56:48.139260 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-baa8da67-ad40-4a60-985b-b4986f5c5186 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:56:48.139701 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-baa8da67-ad40-4a60-985b-b4986f5c5186 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:56:48.140479 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-baa8da67-ad40-4a60-985b-b4986f5c5186 admin admin] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:56:48.140905 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: DEBUG oslo_concurrency.lockutils [None req-baa8da67-ad40-4a60-985b-b4986f5c5186 admin admin] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:56:48.163044 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: INFO nova.api.openstack.requestlog [None req-baa8da67-ad40-4a60-985b-b4986f5c5186 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077818 Jul 25 05:56:48.163528 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: [pid: 115213|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Jul 25 05:56:48 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:57:46.018711 dv-cinder-850831-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 25 05:57:46.019286 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: Mon Jul 25 05:57:46 2022 - graceful shutdown triggered... Jul 25 05:57:46.019742 dv-cinder-850831-1-iscsi devstack@n-api.service[115213]: Gracefully killing worker 1 (pid: 115213)... Jul 25 05:57:46.020105 dv-cinder-850831-1-iscsi devstack@n-api.service[115214]: Gracefully killing worker 2 (pid: 115214)... Jul 25 05:57:47.020502 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: worker 1 buried after 1 seconds Jul 25 05:57:47.020502 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: worker 2 buried after 1 seconds Jul 25 05:57:47.020502 dv-cinder-850831-1-iscsi devstack@n-api.service[115212]: goodbye to uWSGI. Jul 25 05:57:47.021990 dv-cinder-850831-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 25 05:57:47.022578 dv-cinder-850831-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 25 05:57:47.025332 dv-cinder-850831-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 05:57:47.034644 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 05:57:47.036889 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 05:57:47 2022] *** Jul 25 05:57:47.036889 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 05:57:47.036889 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 05:57:47.036889 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: nodename: dv-cinder-850831-1-iscsi Jul 25 05:57:47.036889 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: machine: x86_64 Jul 25 05:57:47.036889 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: clock source: unix Jul 25 05:57:47.036889 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: pcre jit disabled Jul 25 05:57:47.036889 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: detected number of CPU cores: 4 Jul 25 05:57:47.036889 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: current working directory: / Jul 25 05:57:47.036889 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: detected binary path: /usr/bin/uwsgi-core Jul 25 05:57:47.036889 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: your processes number limit is 47680 Jul 25 05:57:47.036889 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: your memory page size is 4096 bytes Jul 25 05:57:47.036889 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: detected max file descriptor number: 2048 Jul 25 05:57:47.036889 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: lock engine: pthread robust mutexes Jul 25 05:57:47.037809 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: thunder lock: enabled Jul 25 05:57:47.037809 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 05:57:47.037809 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 05:57:47.082201 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: Python main interpreter initialized at 0x55fca350d9c0 Jul 25 05:57:47.082201 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: python threads support enabled Jul 25 05:57:47.082201 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: your server socket listen backlog is limited to 100 connections Jul 25 05:57:47.082201 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: your mercy for graceful operations on workers is 90 seconds Jul 25 05:57:47.082664 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 05:57:47.082749 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: *** Operational MODE: preforking *** Jul 25 05:57:47.083010 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: *** uWSGI is running in multiple interpreter mode *** Jul 25 05:57:47.083010 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: spawned uWSGI master process (pid: 130144) Jul 25 05:57:47.083210 dv-cinder-850831-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 05:57:47.083799 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: spawned uWSGI worker 1 (pid: 130162, cores: 1) Jul 25 05:57:47.083947 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: spawned uWSGI worker 2 (pid: 130163, cores: 1) Jul 25 05:57:47.083947 dv-cinder-850831-1-iscsi devstack@n-api.service[130144]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 05:57:47.748323 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 05:57:47.752593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 05:57:48.943729 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:57:48.943729 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: from cryptography.utils import int_from_bytes Jul 25 05:57:48.944334 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:57:48.944334 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: from cryptography.utils import int_from_bytes Jul 25 05:57:48.944728 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:57:48.944728 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: from cryptography.utils import int_from_bytes Jul 25 05:57:48.944871 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:57:48.944871 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: from cryptography.utils import int_from_bytes Jul 25 05:57:51.259567 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 05:57:51.260203 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 05:57:51.260287 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 05:57:51.260614 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 05:57:51.260870 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 05:57:51.261259 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.261585 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.261904 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.262221 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.262570 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.262881 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.263200 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.263516 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.263847 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.264105 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.264433 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.264740 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850831-1-iscsi {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.265060 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.265365 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.265488 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 05:57:51.265846 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.265931 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 05:57:51.266022 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.266266 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.266615 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.266876 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 05:57:51.266984 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.267937 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.268088 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 05:57:51.269294 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 05:57:51.269424 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.269424 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.269580 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.269663 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.269663 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.269822 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.269899 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.270223 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.270424 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.270665 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.270908 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.271025 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.271261 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.271484 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.271590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.272329 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850831-1-iscsi {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.272448 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.272533 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.272614 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.272687 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.272774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.272846 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.273188 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.273408 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.273650 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.273905 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.274124 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.274362 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.274598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850831-1-iscsi {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.274831 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.275049 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.275266 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.275482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.275696 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.275914 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.276130 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.276335 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.276579 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.276799 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.277017 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.277205 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.277399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.277586 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.277739 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.277739 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.278069 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.278237 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.278400 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.278625 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.278787 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.278941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.279085 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.279244 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.279392 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.279548 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.279699 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.279892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.280101 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.280260 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.280404 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.280556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.280717 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.280862 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.281021 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.281174 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.281174 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.281545 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.281688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.281831 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850831-1-iscsi {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.281981 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.282140 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.282616 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.282783 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.282935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.283674 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.284451 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.284623 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.284770 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.284919 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.285070 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.285212 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.285367 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.285519 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.285670 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.285813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.285965 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.286213 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.286642 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.286794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.286945 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.287096 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.287247 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.287396 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.287556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.287699 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.287848 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.287997 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.288145 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.288298 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.288454 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.288605 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.288748 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.288900 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.289043 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.289205 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.289350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.289500 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.289500 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.289782 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.289933 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.290099 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.290252 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.290395 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.290577 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.290577 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.290856 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.291011 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.291164 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.291307 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.291457 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.291606 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.291606 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.291911 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.292054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.292205 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.292366 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.292738 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.292901 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.293052 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.293201 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.293361 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.293513 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.293665 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.293819 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.294261 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.294645 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.294806 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.294960 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.295121 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.295271 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.295422 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.295576 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.295720 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.295869 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.296027 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.296171 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.296321 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.296473 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.296634 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.296784 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.296937 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.297086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.297236 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.297388 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.297541 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.297684 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.297837 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.297980 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.298137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.298286 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.298445 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.298652 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.298970 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.299130 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.299274 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.299470 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.299621 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.299773 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.299922 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.300065 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.300208 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.300358 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.300510 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.300680 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.300824 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.300966 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.301117 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.301261 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.301403 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.301552 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.301695 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.301836 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.301994 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.302300 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.302446 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.302842 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.303022 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.303167 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.303325 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.303476 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.303627 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.303779 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.303931 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.304382 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.304735 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.304891 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.305051 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.305202 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.305347 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.305518 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.305670 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.305849 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.305995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.306145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.306295 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.306452 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.306648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.306792 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.306944 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.307095 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.307246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.307403 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.307558 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.307708 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.307859 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.308011 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.308162 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.308313 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.308462 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.308606 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.308756 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.308922 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.309076 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.309219 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.309378 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.309532 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.309684 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.309827 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.309970 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.310120 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.310120 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.310412 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.310579 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.310734 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.310885 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.311028 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.311178 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.311345 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.311489 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.311641 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.311793 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.311936 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.312156 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.312301 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.312444 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.312597 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.312964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.313127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.313282 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.313426 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.313578 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.313722 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.313864 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.313864 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.314486 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.314646 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.315002 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.315161 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.315318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.315462 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.315618 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.315763 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.315919 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.316062 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.316204 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.316355 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.316506 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.316656 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.316806 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.316949 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.317103 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.317255 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.317398 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.317548 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.317699 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.317852 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:57:51.317995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.318147 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.318298 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.318449 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.318669 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.318831 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.318977 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.319134 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.319290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.319434 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.319578 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.319730 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.319879 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.320030 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.320187 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.320331 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.320480 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.320630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.320773 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.320928 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.321072 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.321222 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.321373 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.321524 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.321678 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.321834 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.321978 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.322121 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.322262 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.322411 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.322592 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.322746 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.323108 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.323271 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.323416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.323565 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.323709 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.323871 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.324025 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.324169 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.324547 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.324774 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.325125 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.325287 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.325432 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.325575 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.325718 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.325860 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.326010 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.326161 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.326317 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.326487 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.326654 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.326797 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.326949 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.327094 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.327243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.327387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.327529 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.327816 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.327996 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.328151 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.328305 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.328449 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.328591 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.328754 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.328907 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.329059 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.329202 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.329344 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.329495 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.329653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.329803 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.330586 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.330811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.330978 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.331130 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.331287 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.331439 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.331591 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.331734 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.331914 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.332078 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.332328 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.332478 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.332630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.332774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.332924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.333297 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.333469 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.333623 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.333768 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.333910 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.334053 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.334209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.334378 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.334753 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.334984 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.335157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.335491 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.335657 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.335816 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.335971 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.336123 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.336732 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.336898 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.337055 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.337207 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.337365 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.337518 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.337662 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.337806 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.337967 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.338121 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.338272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.338416 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.338646 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.338802 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.338802 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.339089 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.339244 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.339394 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.339537 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.339693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.339843 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.339987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.340140 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.340140 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.340419 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.340571 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.340716 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.340866 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.340972 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.341107 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.341238 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.341447 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.341588 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.341717 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.341845 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.341973 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.342112 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.342251 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.342389 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.342532 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.342673 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.346299 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.346465 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.346663 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.346782 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.346906 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.347027 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.347140 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.347262 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.347383 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.347495 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.347604 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.347714 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.347831 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.347958 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.348077 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.348217 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.348358 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.348488 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.348631 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.348768 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.348906 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.349039 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.349153 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.349263 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.349386 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.349524 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.349655 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.349790 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.349926 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.350065 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.350212 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.350343 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.350487 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.350617 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.350762 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.350978 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.351130 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.351130 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.351343 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.351343 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.351343 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.351666 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.351796 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.351796 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.352195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.352329 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.352329 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.352594 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.352724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.352853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.352989 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.353127 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.353257 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.353399 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.353536 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.353682 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.353812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.353940 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.354076 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.354215 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.354344 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.354344 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.354669 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.354870 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.355017 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.355155 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.355155 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.355155 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.355155 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.355155 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.355155 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.355155 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.355155 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.356827 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.356964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.357102 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.357102 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.357102 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.357492 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.357622 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.357622 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.357622 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.358001 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.358137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.358137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.358137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.358137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.358137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.358771 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.358913 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.358913 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.359165 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.359294 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.359294 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.359547 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.359689 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.359689 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.359942 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.360070 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.360070 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.360330 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.360459 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.360459 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.360770 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.360927 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.361092 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.361233 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.361233 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.361488 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.361617 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.361781 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.361926 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.361926 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.362188 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.362389 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.362389 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.362678 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.362809 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.362937 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.363067 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.363067 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.363309 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.363452 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.363452 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.363696 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.363824 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.363824 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.364083 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.364228 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.364228 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.364482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.364618 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.364618 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.364869 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.365011 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.365149 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.365434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.365434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.366300 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.366750 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.366750 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.367035 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.367171 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.367171 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.367433 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.367576 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.367721 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.367854 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.367854 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.368109 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.368242 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.368242 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.368507 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.368638 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.368638 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.368900 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.369031 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.369031 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.369297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.369428 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.369566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.369697 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.369697 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.369957 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.369957 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.370204 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.370204 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.370458 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.370655 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.370796 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.370928 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.370928 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.371183 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.371375 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.371375 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.371716 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.371854 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.371993 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.372132 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.372132 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.372405 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.372622 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.372622 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.372888 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.373031 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.373031 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.373279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.373417 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.373417 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.373684 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.373816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.373816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.374062 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.374200 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.374332 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.374496 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.374496 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.374747 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.374890 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.374890 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.375156 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.375301 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.375301 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.375560 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.376115 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.376252 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.376393 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.376393 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.376673 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.376974 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.376974 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.377240 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.377380 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.377602 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.377747 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.377889 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.378028 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.378028 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.378285 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.378418 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.378618 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.378766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.378766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.379035 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.379174 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.379314 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.379453 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.379453 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.379708 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.379855 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.379855 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.380111 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.380242 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.380380 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.380518 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.380518 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.380781 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.380920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.380920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.381176 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.381314 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.381459 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.381590 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.381720 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.381978 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.382115 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.382366 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.382528 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.382750 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.382897 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.383039 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.383304 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.383451 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.383607 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.383804 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.384069 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.384206 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.384337 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.384504 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.384748 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.384891 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.385100 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.385242 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.385416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.385704 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.386212 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.386212 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.386537 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.386673 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.386819 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.387215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.387215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.387491 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.387632 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.387773 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.387919 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.387919 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.388188 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.388321 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.388452 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.388582 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.388728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.388899 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.389036 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.389247 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.389381 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.389555 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.389815 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.389959 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.390179 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.390313 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.390497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.390763 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.390899 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.391122 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.391254 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.391426 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.391671 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.391820 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.392021 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.392162 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.392900 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.393116 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.393253 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.393434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.393620 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.393755 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.394103 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.394255 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.394389 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.394571 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.394706 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.394957 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.395090 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.395261 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.395446 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.395590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.395884 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.396349 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.396349 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.397425 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.397580 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.397580 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.397842 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.397986 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.398365 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.398526 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.398526 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.398778 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.398945 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.399522 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.399671 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.399671 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.399937 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.400078 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.400221 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.400361 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.400361 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.400766 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.400911 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.401052 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.401194 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.401194 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.401444 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.401574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.401574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.401844 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.401976 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.402107 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.402246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.402246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.402554 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.402697 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.402697 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.402971 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.403175 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.403319 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.403452 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.403452 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.403702 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.403840 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.403982 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.404129 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.404354 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.404488 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.404626 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.404896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.405032 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.405207 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.405376 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.405519 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.405808 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.405976 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.406134 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.406670 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.406801 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.406947 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.407082 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.407082 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.407543 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.407680 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.407825 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.407958 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.407958 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.408793 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.408941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.409083 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.409216 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.409491 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.409841 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.409990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.410125 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.410258 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.410390 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.410544 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.410725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.411035 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.411183 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.411568 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.411703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.411890 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.412041 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.412195 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.412481 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.412611 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.412920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.413012 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.413234 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.413426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.413540 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.413832 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.413925 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.414139 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.414359 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.414454 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.414765 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.414869 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.415092 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.415187 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.415399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.415495 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.415702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.415805 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.416014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.416113 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.416318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.416675 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.416776 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.416872 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.416968 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.417061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.417244 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.417339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.417564 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.417680 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.417880 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.418053 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.418216 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.418360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.418533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.418677 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.418814 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.419001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.419125 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.419324 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.419447 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.419648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.419764 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.419953 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.420071 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.420269 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.420379 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.420578 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.420678 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.420899 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.420994 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.421221 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.421316 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.421530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.421634 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.421844 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.421947 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.422147 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.422242 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.422481 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.422590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.422809 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.422904 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.423118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.423213 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.423432 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.423537 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.423774 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.423870 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.424083 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.424178 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.424411 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.424550 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.424726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.424867 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.425035 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.425169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.425344 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.425485 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.425658 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.425800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.425966 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.426099 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.426268 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.426420 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.426580 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.426722 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.426907 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.427064 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.427291 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.427436 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.427581 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.427942 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.428042 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.428138 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.428239 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.428326 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.428411 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.428496 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.428670 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.428779 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.428989 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.429098 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.429290 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.429390 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.429598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.429702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.429905 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.430005 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.430209 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.430344 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.430548 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.430685 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.430855 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.430958 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.431170 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.431262 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.431473 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.431575 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.431777 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.431878 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.432078 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.432176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.432378 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.432478 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.432717 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.432846 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.433018 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.433117 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.433337 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.433495 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.433661 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.433755 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.433981 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.434079 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.434292 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.434386 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.434645 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.434749 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.434962 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.435053 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.435272 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.435373 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.435584 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.435682 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.435896 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.436034 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.436218 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.436313 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.436554 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.436960 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.437088 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.437221 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.437221 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.437446 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.437568 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.437684 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.437806 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.437949 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.438409 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.438626 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.438763 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.438894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.439017 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.439131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.439271 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.439400 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.439527 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.439725 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.439856 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.439970 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.440082 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.440195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.440307 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.440433 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.440548 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.440661 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.440873 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.441180 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.441525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.441834 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.442048 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.442190 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.442390 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.442513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.454778 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.455534 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.455632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.455734 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.455734 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.455895 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.455990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.456079 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.456179 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.456266 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.456358 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.456499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.456608 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.456705 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.456866 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.457004 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.457167 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.457259 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.457354 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.457449 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.460904 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.461167 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.461332 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.461485 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.461589 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.461680 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.461774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.461868 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.461961 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.462062 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.462062 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.462273 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.463141 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.463272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.463371 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.463470 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.463566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.463661 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.463802 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.463902 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.463997 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.464196 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.464296 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.464382 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.464520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.464610 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.464610 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.464787 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.464879 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.465023 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.465122 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.465216 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.465316 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.465404 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.465546 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.465644 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.465738 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.465825 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.465825 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.465995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.465995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.466158 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.466250 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.466350 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.466350 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.466546 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.466635 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.466732 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.466820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.466970 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.467107 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.467197 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.467338 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.467429 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.467429 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.467593 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.467680 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.467771 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.467857 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.467949 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.468048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.468135 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.468219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.468304 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.468388 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.468480 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.468578 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.468665 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.468744 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.468834 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.468920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.469005 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.469103 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.469201 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.469294 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.469381 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.469471 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.469600 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.469696 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.469791 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.469876 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.469962 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.470045 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.470143 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.470230 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.470328 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.470415 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.470560 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.471178 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.471280 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.471363 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.471608 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.471759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.471858 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.471952 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.472051 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.472138 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.472231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.472323 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.472416 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.472510 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.472602 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.472688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.472773 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.472857 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.472947 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.473041 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.473129 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.473219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.473312 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.473398 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.473483 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.473576 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.473669 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.473762 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.473854 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.473996 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.474093 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.474189 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.474276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.474360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.474443 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.474548 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.474658 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.474757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.474851 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.474851 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.475022 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.475115 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.475210 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.475303 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.475397 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.475491 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.475576 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.475711 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.475875 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.475967 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.476060 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.476146 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.476237 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.476323 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.476420 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.476513 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.476606 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.476606 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.476760 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.476862 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.476949 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.477083 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.477219 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.477309 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.477408 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.477543 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.477638 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.477722 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.477814 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.477900 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.478010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.478150 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.478272 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.478394 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.478543 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.478677 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.478780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.478876 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.478969 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.479055 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.479145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.479231 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.479325 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.479412 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.479496 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.479579 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.479663 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.479754 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.479852 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.479938 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.480030 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.480122 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.480220 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.480306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.480399 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.480493 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.480585 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.480670 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.480761 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.480846 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.480939 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.481025 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.481109 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.481192 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.481283 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.481381 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.481518 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.481628 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.481715 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.481795 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.481868 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.481965 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.482058 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.482150 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.482236 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.482328 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.482414 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.482600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.482692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.482783 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.482876 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.482969 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.483062 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.483156 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.483249 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.483336 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.483426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.483511 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.483608 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.483701 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.483787 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.483787 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.483949 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.483949 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.484251 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.484251 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.484428 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.484428 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.484585 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.484674 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.484769 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.484856 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.484946 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.485039 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.485125 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.485217 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.485316 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.485402 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.485494 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.485579 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.485662 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.485758 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.485839 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.485931 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.486017 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.486124 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.486211 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.486309 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.486397 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.486496 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.486659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.486751 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.486751 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.486925 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.487012 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.487103 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.487177 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.487304 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.487408 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.487504 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.487632 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.487726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.487812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.487905 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.488000 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.488177 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.488266 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.488400 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.488490 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.488589 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.488685 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.488772 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.488862 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.488954 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.489047 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.489183 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.489288 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.489508 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.489604 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.489839 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.489934 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.490162 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.490265 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.490530 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.490628 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.490818 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.490915 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.491124 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.491224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.491440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.491539 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.491800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.491913 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.492118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.492211 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.492426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.492529 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.492741 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.492848 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.493061 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.493155 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.493378 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.493470 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.493687 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.493787 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.493998 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.494096 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.494306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.494408 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.494645 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.494740 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.494960 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.495053 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.495275 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.495376 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.495592 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.495686 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.495909 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.496036 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.496212 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.496331 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.496518 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.496614 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.496830 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.496925 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.497151 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.497303 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.497462 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.497567 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.497768 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.497870 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.498071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.498296 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.498390 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.498658 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.498803 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.498985 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.499114 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.499287 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.499421 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.499593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.499689 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.499902 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.500002 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.500205 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.500309 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.500508 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.500610 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.500811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.500918 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.501112 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.501213 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.501416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.501509 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.502243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.502399 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.502576 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.502671 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.502880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.502984 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.503185 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.503289 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.503489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.503592 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.503795 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.503888 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.504097 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.504200 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.504434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.504638 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.504765 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.504991 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.505094 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.505311 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.505412 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.505643 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.505738 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.505972 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.506082 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.506289 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.506390 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.506621 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.506716 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.506943 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.507049 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.507257 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.507389 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.507563 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.507659 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.507882 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.507986 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.508188 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.508287 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.508494 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.508616 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.508801 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.508899 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.509111 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.509211 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.509419 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.509513 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.509769 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.509870 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.510036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.510138 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.510342 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.510443 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.510680 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.510782 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.510992 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.511084 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.511299 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.511407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.511606 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.511699 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.511919 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.512020 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.512226 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.512331 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.512530 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.512632 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.512835 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.512928 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.513141 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.513248 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.513449 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.513541 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.513752 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.513843 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.514064 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.514187 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.514370 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.514507 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.515161 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.515258 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.515336 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.515408 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.515480 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.515558 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.515631 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.515711 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.516114 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.516221 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.516221 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.516375 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.516536 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.516639 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.516851 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.516944 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.517174 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.517268 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.518223 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.518420 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.518539 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.518627 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.518708 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.518875 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.519024 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.519125 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.519345 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.519474 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.519655 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.519883 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.519968 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.520190 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 05:57:51.520284 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.520533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.520872 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.521207 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.521516 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.521853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.522181 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.522542 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.522827 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.523142 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.523457 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.523774 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.524089 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.524404 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.524720 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.525037 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.525350 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.525665 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.525978 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.526293 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.526638 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.526966 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.527329 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.527665 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.527984 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.528366 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.528694 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.529012 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.529331 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.529646 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.529959 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.530280 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.530643 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.530964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.531277 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.531721 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.532040 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.532367 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.532694 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.533042 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.533371 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.533703 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.534048 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.534375 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.534717 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.535054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.535404 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.535739 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.536072 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.536645 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.536955 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.537269 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.537585 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.537909 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.538223 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.538557 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.538864 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.539179 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.539488 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.539798 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.540105 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.540411 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.540724 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.541031 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.541339 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.541646 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.541952 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.542260 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.542590 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.542905 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.543239 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.543548 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.543856 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.544165 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.544472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.544817 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.545154 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.545475 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.545802 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.546120 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.546447 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.546782 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.547118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.547443 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.547765 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.548079 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.548416 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.548769 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.549082 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.549396 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.549713 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.550026 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.550341 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.550707 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.551041 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.551351 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.551680 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.552004 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.552329 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.552650 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.552966 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.553297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.553601 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.553917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.554233 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.554572 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.554888 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.555209 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.555525 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.555840 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.556160 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.556480 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.556831 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.557626 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.557626 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.557835 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.558095 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.558554 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.558831 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.559188 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.559520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.559840 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.560158 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.560467 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:57:51.560715 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 05:57:51.672598 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO dbcounter [None req-b157cc78-5c6d-4f78-9174-72b921edbc8a None None] Registered counter for database nova_api Jul 25 05:57:51.694163 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_db.sqlalchemy.engines [None req-b157cc78-5c6d-4f78-9174-72b921edbc8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130163) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:57:51.702112 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writer thread running {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:57:51.712244 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO dbcounter [None req-69f01811-261c-4acd-850a-478f59639930 None None] Registered counter for database nova_api Jul 25 05:57:51.732345 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_db.sqlalchemy.engines [None req-69f01811-261c-4acd-850a-478f59639930 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:57:51.739537 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writer thread running {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:57:51.759457 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.context [None req-b157cc78-5c6d-4f78-9174-72b921edbc8a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e96e4b7c-deb5-4a1c-b19f-218c15ae3652(cell1) {{(pid=130163) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 05:57:51.763609 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b157cc78-5c6d-4f78-9174-72b921edbc8a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:57:51.765176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b157cc78-5c6d-4f78-9174-72b921edbc8a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:57:51.765988 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b157cc78-5c6d-4f78-9174-72b921edbc8a None None] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:57:51.767991 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b157cc78-5c6d-4f78-9174-72b921edbc8a None None] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:57:51.769961 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO dbcounter [None req-b157cc78-5c6d-4f78-9174-72b921edbc8a None None] Registered counter for database nova_cell0 Jul 25 05:57:51.774044 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO dbcounter [None req-b157cc78-5c6d-4f78-9174-72b921edbc8a None None] Registered counter for database nova_cell1 Jul 25 05:57:51.781352 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_db.sqlalchemy.engines [None req-b157cc78-5c6d-4f78-9174-72b921edbc8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130163) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:57:51.784147 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_db.sqlalchemy.engines [None req-b157cc78-5c6d-4f78-9174-72b921edbc8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130163) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:57:51.789068 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writer thread running {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:57:51.792271 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writer thread running {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:57:51.795867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.context [None req-69f01811-261c-4acd-850a-478f59639930 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e96e4b7c-deb5-4a1c-b19f-218c15ae3652(cell1) {{(pid=130162) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 05:57:51.800580 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-69f01811-261c-4acd-850a-478f59639930 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:57:51.802178 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-69f01811-261c-4acd-850a-478f59639930 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:57:51.803032 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-69f01811-261c-4acd-850a-478f59639930 None None] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:57:51.805021 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-69f01811-261c-4acd-850a-478f59639930 None None] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:57:51.807023 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO dbcounter [None req-69f01811-261c-4acd-850a-478f59639930 None None] Registered counter for database nova_cell0 Jul 25 05:57:51.811024 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO dbcounter [None req-69f01811-261c-4acd-850a-478f59639930 None None] Registered counter for database nova_cell1 Jul 25 05:57:51.818150 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_db.sqlalchemy.engines [None req-69f01811-261c-4acd-850a-478f59639930 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:57:51.819962 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_db.sqlalchemy.engines [None req-69f01811-261c-4acd-850a-478f59639930 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:57:51.825476 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writer thread running {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:57:51.828153 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writer thread running {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:57:51.937003 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO dbcounter [None req-b157cc78-5c6d-4f78-9174-72b921edbc8a None None] Registered counter for database nova_cell0 Jul 25 05:57:51.943720 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_db.sqlalchemy.engines [None req-b157cc78-5c6d-4f78-9174-72b921edbc8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130163) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:57:51.948040 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writer thread running {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:57:51.982377 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO dbcounter [None req-69f01811-261c-4acd-850a-478f59639930 None None] Registered counter for database nova_cell0 Jul 25 05:57:51.990658 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_db.sqlalchemy.engines [None req-69f01811-261c-4acd-850a-478f59639930 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:57:51.996630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writer thread running {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:57:52.296656 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: WARNING keystonemiddleware.auth_token [None req-b157cc78-5c6d-4f78-9174-72b921edbc8a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:57:52.305823 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: WARNING keystonemiddleware.auth_token [None req-b157cc78-5c6d-4f78-9174-72b921edbc8a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:57:52.343801 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: WARNING keystonemiddleware.auth_token [None req-69f01811-261c-4acd-850a-478f59639930 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:57:52.351141 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: WARNING keystonemiddleware.auth_token [None req-69f01811-261c-4acd-850a-478f59639930 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:57:52.677433 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: WARNING keystonemiddleware.auth_token [None req-b157cc78-5c6d-4f78-9174-72b921edbc8a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:57:52.683601 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: WARNING keystonemiddleware.auth_token [None req-b157cc78-5c6d-4f78-9174-72b921edbc8a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:57:52.690564 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fca350d9c0 pid: 130163 (default app) Jul 25 05:57:52.714135 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: WARNING keystonemiddleware.auth_token [None req-69f01811-261c-4acd-850a-478f59639930 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:57:52.723360 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: WARNING keystonemiddleware.auth_token [None req-69f01811-261c-4acd-850a-478f59639930 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:57:52.729953 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fca350d9c0 pid: 130162 (default app) Jul 25 05:58:34.305274 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=3 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:58:34.307456 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=3 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:58:34.307456 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=3 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:58:34.308229 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=3 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:58:35.481384 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a158860d-6aec-4459-8daa-c1b0a5468066 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Action: 'create', calling method: .version_select at 0x7f9d38043ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-80421105"}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:58:38.383558 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a158860d-6aec-4459-8daa-c1b0a5468066 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 4.092665 Jul 25 05:58:38.397709 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1154 bytes} [Mon Jul 25 05:58:34 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 4108 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 05:58:38.408065 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=3 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:58:38.410749 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=3 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:58:38.412883 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=3 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:58:38.414968 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=3 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:58:38.843480 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9e0aaef9-61e0-4c0f-9700-c4fbaa777c23 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d3808f9d0>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:39.401667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-9e0aaef9-61e0-4c0f-9700-c4fbaa777c23 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/52de159f-4e30-457e-a052-817daf2ba34a" status: 200 len: 343 microversion: 2.1 time: 0.999826 Jul 25 05:58:39.402255 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 1/2] 10.222.0.17 () {58 vars in 1244 bytes} [Mon Jul 25 05:58:38 2022] GET /compute/v2.1/os-volumes/52de159f-4e30-457e-a052-817daf2ba34a => generated 343 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:58:40.416074 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e6aa9aad-c2fc-4a88-b5ba-a6fd585fb177 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d37f0daf0>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:40.519624 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e6aa9aad-c2fc-4a88-b5ba-a6fd585fb177 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/52de159f-4e30-457e-a052-817daf2ba34a" status: 200 len: 344 microversion: 2.1 time: 0.107928 Jul 25 05:58:40.520432 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1244 bytes} [Mon Jul 25 05:58:40 2022] GET /compute/v2.1/os-volumes/52de159f-4e30-457e-a052-817daf2ba34a => generated 344 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:58:40.533582 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-51d91273-d223-403e-b23e-0c5f6e44e7ec tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Action: 'create', calling method: .version_select at 0x7f9d37f54d30>, body: {"snapshot": {"volume_id": "52de159f-4e30-457e-a052-817daf2ba34a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1150094794"}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:58:41.330367 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-51d91273-d223-403e-b23e-0c5f6e44e7ec tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.801889 Jul 25 05:58:41.335664 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 2/4] 10.222.0.17 () {60 vars in 1161 bytes} [Mon Jul 25 05:58:40 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:58:41.364097 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-919e2784-c065-4353-88c2-477e52d3c29f tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d37f0dc10>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:41.438112 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-919e2784-c065-4353-88c2-477e52d3c29f tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c" status: 200 len: 287 microversion: 2.1 time: 0.100859 Jul 25 05:58:41.439637 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 3/5] 10.222.0.17 () {58 vars in 1250 bytes} [Mon Jul 25 05:58:41 2022] GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:58:41.448910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2813439b-3cb6-42d0-8196-6c1f8c20ab88 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d37f54940>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:41.523597 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2813439b-3cb6-42d0-8196-6c1f8c20ab88 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.078422 Jul 25 05:58:41.524168 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 3/6] 10.222.0.17 () {58 vars in 1139 bytes} [Mon Jul 25 05:58:41 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:58:41.535740 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-1ecce55d-1eb5-47a3-8158-264e114469d6 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d37f28310>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:41.635093 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-1ecce55d-1eb5-47a3-8158-264e114469d6 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c" status: 200 len: 287 microversion: 2.1 time: 0.104346 Jul 25 05:58:41.636095 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1250 bytes} [Mon Jul 25 05:58:41 2022] GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:58:42.648561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d2d3500e-6657-4f96-b4e6-837b71d5059e tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d37f19a60>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:42.731689 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d2d3500e-6657-4f96-b4e6-837b71d5059e tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c" status: 200 len: 287 microversion: 2.1 time: 0.085819 Jul 25 05:58:42.732748 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1250 bytes} [Mon Jul 25 05:58:42 2022] GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:58:43.744910 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8dc531e1-5b76-4bde-b7cd-14bf31c81301 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d37f289d0>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:43.829662 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8dc531e1-5b76-4bde-b7cd-14bf31c81301 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c" status: 200 len: 287 microversion: 2.1 time: 0.088711 Jul 25 05:58:43.830849 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 5/9] 10.222.0.17 () {58 vars in 1250 bytes} [Mon Jul 25 05:58:43 2022] GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:58:44.853619 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-aa6d4173-be09-4f4f-819d-bd87d0f89116 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d37f291f0>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:44.930382 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-aa6d4173-be09-4f4f-819d-bd87d0f89116 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c" status: 200 len: 287 microversion: 2.1 time: 0.091807 Jul 25 05:58:44.934967 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 5/10] 10.222.0.17 () {58 vars in 1250 bytes} [Mon Jul 25 05:58:44 2022] GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:58:45.967812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9737211c-3f3f-4934-9b71-73e10c17331b tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d37f28af0>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:46.064921 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9737211c-3f3f-4934-9b71-73e10c17331b tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c" status: 200 len: 287 microversion: 2.1 time: 0.116731 Jul 25 05:58:46.072770 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 6/11] 10.222.0.17 () {58 vars in 1250 bytes} [Mon Jul 25 05:58:45 2022] GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c => generated 287 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:58:47.085607 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ca7c6844-314e-4b99-91a4-845f53587c1a tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d37f19a60>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:47.477122 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ca7c6844-314e-4b99-91a4-845f53587c1a tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c" status: 200 len: 287 microversion: 2.1 time: 0.398454 Jul 25 05:58:47.478144 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1250 bytes} [Mon Jul 25 05:58:47 2022] GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c => generated 287 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:58:48.489246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d7fa7451-bcc1-434a-a56c-2a379bb2dc33 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d37f28550>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:48.571007 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d7fa7451-bcc1-434a-a56c-2a379bb2dc33 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c" status: 200 len: 288 microversion: 2.1 time: 0.085200 Jul 25 05:58:48.573381 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1250 bytes} [Mon Jul 25 05:58:48 2022] GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c => generated 288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:58:48.581837 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-608570ca-679d-4065-99f5-2005b6fe3e42 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d37f19280>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:48.789360 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-608570ca-679d-4065-99f5-2005b6fe3e42 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c" status: 202 len: 0 microversion: 2.1 time: 0.211847 Jul 25 05:58:48.790521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 7/14] 10.222.0.17 () {58 vars in 1253 bytes} [Mon Jul 25 05:58:48 2022] DELETE /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:58:48.799377 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-51e13d90-67c1-4bcd-bc8b-9acb8622f96a tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d37f0d9d0>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:48.868123 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-51e13d90-67c1-4bcd-bc8b-9acb8622f96a tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c" status: 200 len: 287 microversion: 2.1 time: 0.073455 Jul 25 05:58:48.871569 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 8/15] 10.222.0.17 () {58 vars in 1250 bytes} [Mon Jul 25 05:58:48 2022] GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:58:49.598900 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f2000c66-bb57-4a9a-b8a3-29c1be289f55 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1566808889", "imageRef": "bfffd6ef-7f99-4a99-90f3-027fe9c89821", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:58:49.843046 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.network.neutron [None req-f2000c66-bb57-4a9a-b8a3-29c1be289f55 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] validate_networks() for [('b267e454-5603-4afc-b3f7-189ef5d55d73', None, None, None, None, None)] {{(pid=130162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:58:49.883892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8d085013-adac-4b02-8b3a-a357aab0a0dc tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d37f31160>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:49.968640 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-8d085013-adac-4b02-8b3a-a357aab0a0dc tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] HTTP exception thrown: Snapshot 2c6d63dc-ce04-4063-b3f9-73653ef15d8c could not be found. Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8d085013-adac-4b02-8b3a-a357aab0a0dc tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Request method failure captured: Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c HTTP/1.1 Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEK_bMN7-o1egT9AqRiBqd1AioZP8JeLTqwXEHrhZZEjAOuOJn-4JhY7G8ibs7wO1BN4Ch6LFCrrC7dDdHZOJeS8ZJXsTVXxnsuR4pS5IiskZL0FkzdrsQ25AUPbF5jj2v2m6EfwKyvtIhpzX_GyuD9y0r2NuzaHBijEc4Ayvuz7oA Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 801185ee50e945d1a4c1f7bf75694bf5 Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-406434446 Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 05:58:49.973530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 05:58:49.974703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/801185ee50e945d1a4c1f7bf75694bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/801185ee50e945d1a4c1f7bf75694bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/801185ee50e945d1a4c1f7bf75694bf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_801185ee50e945d1a4c1f7bf75694bf5", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 05:58:49.974703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-VolumesSnapshotsTestJSON-406434446 Jul 25 05:58:49.974703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 801185ee50e945d1a4c1f7bf75694bf5 Jul 25 05:58:49.974703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-406434446 Jul 25 05:58:49.974703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-VolumesSnapshotsTestJSON-406434446-project Jul 25 05:58:49.974703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 05:58:49.974703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 05:58:49.974703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: dcec6f4073664b04a33e6e04fb29eb37 Jul 25 05:58:49.974703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-VolumesSnapshotsTestJSON-406434446-project Jul 25 05:58:49.974703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: Jul 25 05:58:49.974703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Snapshot 2c6d63dc-ce04-4063-b3f9-73653ef15d8c could not be found. Jul 25 05:58:49.974703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '2c6d63dc-ce04-4063-b3f9-73653ef15d8c'} Jul 25 05:58:49.974703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2c6d63dc-ce04-4063-b3f9-73653ef15d8c could not be found. (HTTP 404) (Request-ID: req-466ade22-26f7-406b-8f81-1d23b90d4b03) Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:49.975399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:58:49.976279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2c6d63dc-ce04-4063-b3f9-73653ef15d8c could not be found. Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 25 05:58:49.979717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:58:49.980712 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2c6d63dc-ce04-4063-b3f9-73653ef15d8c could not be found. Jul 25 05:58:49.980712 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:49.980712 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:58:49.980712 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:49.980712 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:58:49.980712 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:58:49.980712 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:58:49.980712 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:58:49.980712 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:58:49.980712 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2c6d63dc-ce04-4063-b3f9-73653ef15d8c could not be found. Jul 25 05:58:49.980712 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:49.980712 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8d085013-adac-4b02-8b3a-a357aab0a0dc tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Returning 404 to user: Snapshot 2c6d63dc-ce04-4063-b3f9-73653ef15d8c could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:58:49.980712 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8d085013-adac-4b02-8b3a-a357aab0a0dc tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c" status: 404 len: 111 microversion: 2.1 time: 0.095797 Jul 25 05:58:49.980712 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 9/16] 10.222.0.17 () {58 vars in 1250 bytes} [Mon Jul 25 05:58:49 2022] GET /compute/v2.1/os-snapshots/2c6d63dc-ce04-4063-b3f9-73653ef15d8c => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:58:50.000056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-bc58a9cb-54f0-4811-aeaf-076d96159c60 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d37f310d0>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:50.306295 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-bc58a9cb-54f0-4811-aeaf-076d96159c60 tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/52de159f-4e30-457e-a052-817daf2ba34a" status: 202 len: 0 microversion: 2.1 time: 0.324715 Jul 25 05:58:50.308290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 10/17] 10.222.0.17 () {58 vars in 1247 bytes} [Mon Jul 25 05:58:49 2022] DELETE /compute/v2.1/os-volumes/52de159f-4e30-457e-a052-817daf2ba34a => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:58:50.320713 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-647914b7-2972-4437-b561-b652c5c436de tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d37f0dee0>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:50.399515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-647914b7-2972-4437-b561-b652c5c436de tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/52de159f-4e30-457e-a052-817daf2ba34a" status: 200 len: 343 microversion: 2.1 time: 0.085844 Jul 25 05:58:50.400398 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 11/18] 10.222.0.17 () {58 vars in 1244 bytes} [Mon Jul 25 05:58:50 2022] GET /compute/v2.1/os-volumes/52de159f-4e30-457e-a052-817daf2ba34a => generated 343 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:58:51.102917 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-33dbb523-444a-4a8e-a2b6-38fb6fd74e62 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Action: 'create', calling method: .version_select at 0x7f9d37f311f0>, body: {"keypair": {"name": "tempest-keypair-57793209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF22Jz1OZJKYWMgdPgNcMkdNXg/WXzf4zkptwQhiuKY/0aopU/81TVNCWVQy5HkjSrvsd5d7e7OPTwkyVTmNzYA/T7rNbCwJk6zlPkSFobO3TxXzwcjy6fUhUGudtcPk0Q=="}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:58:51.198843 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-33dbb523-444a-4a8e-a2b6-38fb6fd74e62 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Getting quotas for project d45136a1cdbf4e93b9cf71d33443220f. Resources: {'key_pairs'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:58:51.208365 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-33dbb523-444a-4a8e-a2b6-38fb6fd74e62 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Getting quotas for user 7f269cd38f734209ba0496cf70469608 and project d45136a1cdbf4e93b9cf71d33443220f. Resources: {'key_pairs'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:58:51.398070 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-33dbb523-444a-4a8e-a2b6-38fb6fd74e62 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.396773 Jul 25 05:58:51.399134 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 12/19] 10.222.0.17 () {62 vars in 1199 bytes} [Mon Jul 25 05:58:51 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 398 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 05:58:51.517684 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a4e870c6-a7db-4825-a246-f70b1f053e4f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Action: 'create', calling method: .version_select at 0x7f9d37e57af0>, body: {"keypair": {"name": "tempest-keypair-256098023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4Rv648wCjA9Kj5Bq+fYXtmFM9iulRR5sIcbHy+0bg65c+FR7gXHSHkLEZXs+Xm39mp/w7BcgUEdJYfAY6p7aaot/X+kNRX0BdIkLb0Yxdc5yGYmceKdT4YrjHaBA35oQ=="}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:58:51.576066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-a4e870c6-a7db-4825-a246-f70b1f053e4f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Getting quotas for project 488e87a8233e4e69a07cd8efba37cad7. Resources: {'key_pairs'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:58:51.599401 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-a4e870c6-a7db-4825-a246-f70b1f053e4f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Getting quotas for user 6dc49525e3394668b4f1610c4badc144 and project 488e87a8233e4e69a07cd8efba37cad7. Resources: {'key_pairs'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:58:51.762010 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a4e870c6-a7db-4825-a246-f70b1f053e4f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.361281 Jul 25 05:58:51.763053 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 13/20] 10.222.0.17 () {60 vars in 1158 bytes} [Mon Jul 25 05:58:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:58:51.772782 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-64240412-215b-4f84-b95c-1140c800614b tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d3760d8b0>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:51.869068 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-64240412-215b-4f84-b95c-1140c800614b tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] HTTP exception thrown: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-64240412-215b-4f84-b95c-1140c800614b tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Request method failure captured: Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/os-volumes/52de159f-4e30-457e-a052-817daf2ba34a HTTP/1.1 Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEK_bMN7-o1egT9AqRiBqd1AioZP8JeLTqwXEHrhZZEjAOuOJn-4JhY7G8ibs7wO1BN4Ch6LFCrrC7dDdHZOJeS8ZJXsTVXxnsuR4pS5IiskZL0FkzdrsQ25AUPbF5jj2v2m6EfwKyvtIhpzX_GyuD9y0r2NuzaHBijEc4Ayvuz7oA Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 801185ee50e945d1a4c1f7bf75694bf5 Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-406434446 Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 05:58:51.872224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 05:58:51.873299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/801185ee50e945d1a4c1f7bf75694bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/801185ee50e945d1a4c1f7bf75694bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/801185ee50e945d1a4c1f7bf75694bf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_801185ee50e945d1a4c1f7bf75694bf5", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 05:58:51.873299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-VolumesSnapshotsTestJSON-406434446 Jul 25 05:58:51.873299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 801185ee50e945d1a4c1f7bf75694bf5 Jul 25 05:58:51.873299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-406434446 Jul 25 05:58:51.873299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-VolumesSnapshotsTestJSON-406434446-project Jul 25 05:58:51.873299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 05:58:51.873299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 05:58:51.873299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: dcec6f4073664b04a33e6e04fb29eb37 Jul 25 05:58:51.873299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-VolumesSnapshotsTestJSON-406434446-project Jul 25 05:58:51.873299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: Jul 25 05:58:51.873299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. Jul 25 05:58:51.873299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '52de159f-4e30-457e-a052-817daf2ba34a'} Jul 25 05:58:51.873299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. (HTTP 404) (Request-ID: req-5feb7fb1-319e-4471-9329-58889aabd3df) Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:58:51.874088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:58:51.879071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 05:58:51.880215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:58:51.881603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. Jul 25 05:58:51.881603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:51.881603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:58:51.881603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:51.881603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:58:51.881603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:58:51.881603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:58:51.881603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:58:51.881603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:58:51.881603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. Jul 25 05:58:51.881603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:51.881603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-64240412-215b-4f84-b95c-1140c800614b tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Returning 404 to user: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:58:51.881603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-64240412-215b-4f84-b95c-1140c800614b tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/52de159f-4e30-457e-a052-817daf2ba34a" status: 404 len: 109 microversion: 2.1 time: 0.112180 Jul 25 05:58:51.881603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 14/21] 10.222.0.17 () {58 vars in 1244 bytes} [Mon Jul 25 05:58:51 2022] GET /compute/v2.1/os-volumes/52de159f-4e30-457e-a052-817daf2ba34a => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:58:52.132625 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c35462ba-a8de-4367-b8cf-9b67ddda98a6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Action: 'create', calling method: .version_select at 0x7f9d3760dd30>, body: {"keypair": {"name": "tempest-keypair-1253193146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEH90J+h31NaQaAIUg4tJhNkRvle8bDgA7iJut8GpPWthqUPxiL3EK2a9ZRIisR73b0PwmZ5r51OJm336xL1IWkbBy89Kd/99Dr0aUXT/cf14DmkAow6y5VDf5YHkja9g=="}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:58:52.179775 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-c35462ba-a8de-4367-b8cf-9b67ddda98a6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Getting quotas for project 15678135086b4a5c83eefece6cb8f79a. Resources: {'key_pairs'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:58:52.189735 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-c35462ba-a8de-4367-b8cf-9b67ddda98a6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Getting quotas for user dc8b3ecc32c14e31b55156586129a40c and project 15678135086b4a5c83eefece6cb8f79a. Resources: {'key_pairs'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:58:52.327315 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c35462ba-a8de-4367-b8cf-9b67ddda98a6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.448234 Jul 25 05:58:52.330219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 15/22] 10.222.0.17 () {60 vars in 1158 bytes} [Mon Jul 25 05:58:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:58:52.335553 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4cd890d5-2703-40b0-bdd4-72bbea935a6a tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d3760a5e0>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:52.405207 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-4cd890d5-2703-40b0-bdd4-72bbea935a6a tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] HTTP exception thrown: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4cd890d5-2703-40b0-bdd4-72bbea935a6a tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Request method failure captured: Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: DELETE /compute/v2.1/os-volumes/52de159f-4e30-457e-a052-817daf2ba34a HTTP/1.1 Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEK_bMN7-o1egT9AqRiBqd1AioZP8JeLTqwXEHrhZZEjAOuOJn-4JhY7G8ibs7wO1BN4Ch6LFCrrC7dDdHZOJeS8ZJXsTVXxnsuR4pS5IiskZL0FkzdrsQ25AUPbF5jj2v2m6EfwKyvtIhpzX_GyuD9y0r2NuzaHBijEc4Ayvuz7oA Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 801185ee50e945d1a4c1f7bf75694bf5 Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-406434446 Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 05:58:52.407383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 05:58:52.408649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/801185ee50e945d1a4c1f7bf75694bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/801185ee50e945d1a4c1f7bf75694bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/801185ee50e945d1a4c1f7bf75694bf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_801185ee50e945d1a4c1f7bf75694bf5", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 05:58:52.408649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-VolumesSnapshotsTestJSON-406434446 Jul 25 05:58:52.408649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 801185ee50e945d1a4c1f7bf75694bf5 Jul 25 05:58:52.408649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-406434446 Jul 25 05:58:52.408649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-VolumesSnapshotsTestJSON-406434446-project Jul 25 05:58:52.408649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 05:58:52.408649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 05:58:52.408649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: dcec6f4073664b04a33e6e04fb29eb37 Jul 25 05:58:52.408649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-VolumesSnapshotsTestJSON-406434446-project Jul 25 05:58:52.408649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: Jul 25 05:58:52.408649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. Jul 25 05:58:52.408649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '52de159f-4e30-457e-a052-817daf2ba34a'} Jul 25 05:58:52.408649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. (HTTP 404) (Request-ID: req-7d035ba0-30f6-4161-8e0a-0fd9caa0de7f) Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:58:52.409368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 05:58:52.410434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 05:58:52.412348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:58:52.413725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. Jul 25 05:58:52.413725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:52.413725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:58:52.413725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:52.413725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:58:52.413725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:58:52.413725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:58:52.413725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:58:52.413725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:58:52.413725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. Jul 25 05:58:52.413725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:52.413725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4cd890d5-2703-40b0-bdd4-72bbea935a6a tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Returning 404 to user: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:58:52.413725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4cd890d5-2703-40b0-bdd4-72bbea935a6a tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/52de159f-4e30-457e-a052-817daf2ba34a" status: 404 len: 109 microversion: 2.1 time: 0.078771 Jul 25 05:58:52.414550 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 16/23] 10.222.0.17 () {58 vars in 1247 bytes} [Mon Jul 25 05:58:52 2022] DELETE /compute/v2.1/os-volumes/52de159f-4e30-457e-a052-817daf2ba34a => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:58:52.425317 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f758bf43-c91b-481b-b11f-c6c236c311fb tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Calling method '.version_select at 0x7f9d37626310>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:52.544231 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-f758bf43-c91b-481b-b11f-c6c236c311fb tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] HTTP exception thrown: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f758bf43-c91b-481b-b11f-c6c236c311fb tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Request method failure captured: Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/os-volumes/52de159f-4e30-457e-a052-817daf2ba34a HTTP/1.1 Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEK_bMN7-o1egT9AqRiBqd1AioZP8JeLTqwXEHrhZZEjAOuOJn-4JhY7G8ibs7wO1BN4Ch6LFCrrC7dDdHZOJeS8ZJXsTVXxnsuR4pS5IiskZL0FkzdrsQ25AUPbF5jj2v2m6EfwKyvtIhpzX_GyuD9y0r2NuzaHBijEc4Ayvuz7oA Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 801185ee50e945d1a4c1f7bf75694bf5 Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-406434446 Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 05:58:52.547127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 05:58:52.548404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/801185ee50e945d1a4c1f7bf75694bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/801185ee50e945d1a4c1f7bf75694bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/801185ee50e945d1a4c1f7bf75694bf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_801185ee50e945d1a4c1f7bf75694bf5", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 05:58:52.548404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-VolumesSnapshotsTestJSON-406434446 Jul 25 05:58:52.548404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 801185ee50e945d1a4c1f7bf75694bf5 Jul 25 05:58:52.548404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-406434446 Jul 25 05:58:52.548404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-VolumesSnapshotsTestJSON-406434446-project Jul 25 05:58:52.548404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 05:58:52.548404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 05:58:52.548404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: dcec6f4073664b04a33e6e04fb29eb37 Jul 25 05:58:52.548404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-VolumesSnapshotsTestJSON-406434446-project Jul 25 05:58:52.548404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: Jul 25 05:58:52.548404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. Jul 25 05:58:52.548404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '52de159f-4e30-457e-a052-817daf2ba34a'} Jul 25 05:58:52.548404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. (HTTP 404) (Request-ID: req-5a2b5c28-f0ec-46db-99ac-eda8cafcfbca) Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:58:52.549154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:58:52.550120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 05:58:52.551306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:58:52.552351 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. Jul 25 05:58:52.552351 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:52.552351 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:58:52.552351 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:52.552351 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:58:52.552351 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:58:52.552351 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:58:52.552351 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:58:52.552351 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:58:52.552351 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. Jul 25 05:58:52.552351 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:58:52.560353 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f758bf43-c91b-481b-b11f-c6c236c311fb tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] Returning 404 to user: Volume 52de159f-4e30-457e-a052-817daf2ba34a could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:58:52.563149 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f758bf43-c91b-481b-b11f-c6c236c311fb tempest-VolumesSnapshotsTestJSON-406434446 tempest-VolumesSnapshotsTestJSON-406434446-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/52de159f-4e30-457e-a052-817daf2ba34a" status: 404 len: 109 microversion: 2.1 time: 0.145969 Jul 25 05:58:52.566668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 17/24] 10.222.0.17 () {58 vars in 1244 bytes} [Mon Jul 25 05:58:52 2022] GET /compute/v2.1/os-volumes/52de159f-4e30-457e-a052-817daf2ba34a => generated 109 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:58:52.863970 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-f2000c66-bb57-4a9a-b8a3-29c1be289f55 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Flavor limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:58:52.864528 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-f2000c66-bb57-4a9a-b8a3-29c1be289f55 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Image limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:58:52.864933 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-f2000c66-bb57-4a9a-b8a3-29c1be289f55 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Flavor pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:58:52.865393 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-f2000c66-bb57-4a9a-b8a3-29c1be289f55 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Image pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:58:52.865802 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-f2000c66-bb57-4a9a-b8a3-29c1be289f55 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:58:52.914802 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f2000c66-bb57-4a9a-b8a3-29c1be289f55 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:58:52.917503 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f2000c66-bb57-4a9a-b8a3-29c1be289f55 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:58:52.918415 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f2000c66-bb57-4a9a-b8a3-29c1be289f55 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:58:52.923304 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f2000c66-bb57-4a9a-b8a3-29c1be289f55 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:58:53.062955 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-f2000c66-bb57-4a9a-b8a3-29c1be289f55 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Getting quotas for project d30518907b9f4939b1e8666eba12186e. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:58:53.075846 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-f2000c66-bb57-4a9a-b8a3-29c1be289f55 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Getting quotas for user 13e5d648af294c7cbc86ccd362914728 and project d30518907b9f4939b1e8666eba12186e. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:58:53.109439 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f2000c66-bb57-4a9a-b8a3-29c1be289f55 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Going to run 1 instances... {{(pid=130162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:58:53.119650 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f2000c66-bb57-4a9a-b8a3-29c1be289f55 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfffd6ef-7f99-4a99-90f3-027fe9c89821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:58:53.597591 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f2000c66-bb57-4a9a-b8a3-29c1be289f55 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.150093 Jul 25 05:58:53.601465 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 8/25] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 05:58:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 4154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:58:53.611863 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5a698385-26b2-4e7a-b524-9b2fe46ad53d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:53.612948 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5a698385-26b2-4e7a-b524-9b2fe46ad53d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:58:53.831969 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5a698385-26b2-4e7a-b524-9b2fe46ad53d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:58:53.879492 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5a698385-26b2-4e7a-b524-9b2fe46ad53d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1222 microversion: 2.1 time: 0.271894 Jul 25 05:58:53.887670 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 18/26] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:58:53 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1222 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:58:54.321254 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-11d0f1a9-a955-46c0-8cfe-acbb75861a72 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-554437835", "imageRef": "bfffd6ef-7f99-4a99-90f3-027fe9c89821", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:58:54.507846 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e202c847-6e03-46d5-a3b8-75cdc3c67347 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1025871412", "imageRef": "bfffd6ef-7f99-4a99-90f3-027fe9c89821", "flavorRef": "452", "networks": [{"uuid": "7eb6c9e6-9586-4b29-b8b7-8c1b98fc7120"}]}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:58:54.528853 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.network.neutron [None req-11d0f1a9-a955-46c0-8cfe-acbb75861a72 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] validate_networks() for [('b267e454-5603-4afc-b3f7-189ef5d55d73', None, None, None, None, None)] {{(pid=130163) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:58:54.629258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.network.neutron [None req-e202c847-6e03-46d5-a3b8-75cdc3c67347 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] validate_networks() for [('7eb6c9e6-9586-4b29-b8b7-8c1b98fc7120', None, None, None, None, None)] {{(pid=130162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:58:56.321751 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-e202c847-6e03-46d5-a3b8-75cdc3c67347 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Flavor limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:58:56.322343 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-e202c847-6e03-46d5-a3b8-75cdc3c67347 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Image limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:58:56.323664 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-e202c847-6e03-46d5-a3b8-75cdc3c67347 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Flavor pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:58:56.325605 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-e202c847-6e03-46d5-a3b8-75cdc3c67347 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Image pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:58:56.326130 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-e202c847-6e03-46d5-a3b8-75cdc3c67347 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:58:56.370565 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e202c847-6e03-46d5-a3b8-75cdc3c67347 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:58:56.371326 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e202c847-6e03-46d5-a3b8-75cdc3c67347 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:58:56.374544 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e202c847-6e03-46d5-a3b8-75cdc3c67347 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:58:56.383857 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e202c847-6e03-46d5-a3b8-75cdc3c67347 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:58:56.436398 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-e202c847-6e03-46d5-a3b8-75cdc3c67347 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Getting quotas for project bb20b5f0088f4a1c84f17ddb49d851a7. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:58:56.457363 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-e202c847-6e03-46d5-a3b8-75cdc3c67347 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Getting quotas for user 3bc10b641e34490a83bc587262f4c61a and project bb20b5f0088f4a1c84f17ddb49d851a7. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:58:56.515112 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e202c847-6e03-46d5-a3b8-75cdc3c67347 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Going to run 1 instances... {{(pid=130162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:58:56.518020 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e202c847-6e03-46d5-a3b8-75cdc3c67347 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfffd6ef-7f99-4a99-90f3-027fe9c89821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:58:56.743893 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e202c847-6e03-46d5-a3b8-75cdc3c67347 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.669918 Jul 25 05:58:56.745092 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 9/27] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 05:58:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:58:56.760074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-49ec301c-5838-4803-8fc8-8468491a8dc0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:56.762667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-49ec301c-5838-4803-8fc8-8468491a8dc0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:58:56.991596 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-49ec301c-5838-4803-8fc8-8468491a8dc0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:58:57.043818 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-49ec301c-5838-4803-8fc8-8468491a8dc0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1215 microversion: 2.1 time: 0.284407 Jul 25 05:58:57.045829 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 10/28] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:58:56 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1215 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:58:57.322351 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-11d0f1a9-a955-46c0-8cfe-acbb75861a72 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Flavor limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:58:57.322943 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-11d0f1a9-a955-46c0-8cfe-acbb75861a72 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Image limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:58:57.325171 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-11d0f1a9-a955-46c0-8cfe-acbb75861a72 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Flavor pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:58:57.325171 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-11d0f1a9-a955-46c0-8cfe-acbb75861a72 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Image pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:58:57.326408 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-11d0f1a9-a955-46c0-8cfe-acbb75861a72 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:58:57.355659 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-11d0f1a9-a955-46c0-8cfe-acbb75861a72 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:58:57.356133 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-11d0f1a9-a955-46c0-8cfe-acbb75861a72 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:58:57.356949 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-11d0f1a9-a955-46c0-8cfe-acbb75861a72 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:58:57.357395 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-11d0f1a9-a955-46c0-8cfe-acbb75861a72 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:58:57.439631 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-11d0f1a9-a955-46c0-8cfe-acbb75861a72 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Getting quotas for project d30518907b9f4939b1e8666eba12186e. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:58:57.444500 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-11d0f1a9-a955-46c0-8cfe-acbb75861a72 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Getting quotas for user 13e5d648af294c7cbc86ccd362914728 and project d30518907b9f4939b1e8666eba12186e. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:58:57.465069 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-11d0f1a9-a955-46c0-8cfe-acbb75861a72 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Going to run 1 instances... {{(pid=130163) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:58:57.468175 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-11d0f1a9-a955-46c0-8cfe-acbb75861a72 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfffd6ef-7f99-4a99-90f3-027fe9c89821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:58:57.706430 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-11d0f1a9-a955-46c0-8cfe-acbb75861a72 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.396708 Jul 25 05:58:57.708409 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 19/29] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 05:58:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 3405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:58:57.725902 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e2b5ea30-a9e8-4515-a661-84abb099b324 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:57.726767 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e2b5ea30-a9e8-4515-a661-84abb099b324 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:58:58.027527 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e2b5ea30-a9e8-4515-a661-84abb099b324 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:58:58.043721 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e2b5ea30-a9e8-4515-a661-84abb099b324 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1221 microversion: 2.1 time: 0.316555 Jul 25 05:58:58.046432 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 11/30] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:58:57 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1221 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:58:58.062944 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-819b9812-cf54-40e0-b5da-85db6ec69a27 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:58.063709 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-819b9812-cf54-40e0-b5da-85db6ec69a27 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:58:58.782041 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-819b9812-cf54-40e0-b5da-85db6ec69a27 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:58:58.804013 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-819b9812-cf54-40e0-b5da-85db6ec69a27 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1215 microversion: 2.1 time: 0.735227 Jul 25 05:58:58.811365 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 20/31] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:58:58 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1215 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:58:59.063893 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3fcddbc2-d962-45d4-822d-ffeb9d753055 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:59.064605 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3fcddbc2-d962-45d4-822d-ffeb9d753055 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:58:59.245073 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3fcddbc2-d962-45d4-822d-ffeb9d753055 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:58:59.255061 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3fcddbc2-d962-45d4-822d-ffeb9d753055 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1221 microversion: 2.1 time: 0.197693 Jul 25 05:58:59.260096 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 12/32] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:58:59 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1221 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:58:59.614134 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ae1c7a30-1f68-4bba-bb6f-cceb8b5b084f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1729940252", "imageRef": "bfffd6ef-7f99-4a99-90f3-027fe9c89821", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "805986bf-e25e-49a6-a0be-02e60deb2a2d"}], "security_groups": [{"name": "tempest-securitygroup--1986527036"}], "key_name": "tempest-keypair-256098023", "user_data": "}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:58:59.816656 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e177c5b0-c907-4b88-8d78-11b6d0026163 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:58:59.818744 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e177c5b0-c907-4b88-8d78-11b6d0026163 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:58:59.827058 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e177c5b0-c907-4b88-8d78-11b6d0026163 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:58:59.837484 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e177c5b0-c907-4b88-8d78-11b6d0026163 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:58:59.838599 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e177c5b0-c907-4b88-8d78-11b6d0026163 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:58:59.845566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e177c5b0-c907-4b88-8d78-11b6d0026163 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:00.133918 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e177c5b0-c907-4b88-8d78-11b6d0026163 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:00.151637 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e177c5b0-c907-4b88-8d78-11b6d0026163 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1211 microversion: 2.1 time: 0.338696 Jul 25 05:59:00.153567 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 13/33] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:58:59 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1211 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:00.162940 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.network.neutron [None req-ae1c7a30-1f68-4bba-bb6f-cceb8b5b084f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] validate_networks() for [('805986bf-e25e-49a6-a0be-02e60deb2a2d', None, None, None, None, None)] {{(pid=130163) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:59:00.279032 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9282c45e-2457-4680-afaf-9ffa32f6b79a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:00.279923 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-9282c45e-2457-4680-afaf-9ffa32f6b79a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:00.295699 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9282c45e-2457-4680-afaf-9ffa32f6b79a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:00.297919 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9282c45e-2457-4680-afaf-9ffa32f6b79a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:00.301973 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9282c45e-2457-4680-afaf-9ffa32f6b79a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:00.307459 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9282c45e-2457-4680-afaf-9ffa32f6b79a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:00.580899 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-9282c45e-2457-4680-afaf-9ffa32f6b79a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:00.611304 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-9282c45e-2457-4680-afaf-9ffa32f6b79a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1217 microversion: 2.1 time: 0.334844 Jul 25 05:59:00.615203 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 14/34] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:00 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1217 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:00.913336 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-deef45a1-aa58-43e4-8641-1f7c3ec95db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1219469537", "imageRef": "bfffd6ef-7f99-4a99-90f3-027fe9c89821", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60c9a765-6850-40e2-8719-45a95f6696a2"}], "security_groups": [{"name": "tempest-securitygroup--324294931"}], "key_name": "tempest-keypair-57793209", "user_data": "}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:01.291307 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.network.neutron [None req-deef45a1-aa58-43e4-8641-1f7c3ec95db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] validate_networks() for [('60c9a765-6850-40e2-8719-45a95f6696a2', None, None, None, None, None)] {{(pid=130162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:59:02.310448 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-ae1c7a30-1f68-4bba-bb6f-cceb8b5b084f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Flavor limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:59:02.311539 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-ae1c7a30-1f68-4bba-bb6f-cceb8b5b084f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Image limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:59:02.312951 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-ae1c7a30-1f68-4bba-bb6f-cceb8b5b084f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Flavor pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:59:02.313721 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-ae1c7a30-1f68-4bba-bb6f-cceb8b5b084f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Image pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:59:02.314839 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-ae1c7a30-1f68-4bba-bb6f-cceb8b5b084f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:59:02.510281 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ae1c7a30-1f68-4bba-bb6f-cceb8b5b084f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:02.510281 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ae1c7a30-1f68-4bba-bb6f-cceb8b5b084f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:02.510281 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ae1c7a30-1f68-4bba-bb6f-cceb8b5b084f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:02.510281 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ae1c7a30-1f68-4bba-bb6f-cceb8b5b084f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:02.513694 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-ae1c7a30-1f68-4bba-bb6f-cceb8b5b084f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Getting quotas for project 488e87a8233e4e69a07cd8efba37cad7. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:59:02.513694 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-ae1c7a30-1f68-4bba-bb6f-cceb8b5b084f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Getting quotas for user 6dc49525e3394668b4f1610c4badc144 and project 488e87a8233e4e69a07cd8efba37cad7. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:59:02.513694 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ae1c7a30-1f68-4bba-bb6f-cceb8b5b084f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Going to run 1 instances... {{(pid=130163) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:59:02.513694 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ae1c7a30-1f68-4bba-bb6f-cceb8b5b084f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfffd6ef-7f99-4a99-90f3-027fe9c89821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:59:02.941515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ae1c7a30-1f68-4bba-bb6f-cceb8b5b084f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.326825 Jul 25 05:59:02.969292 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 21/35] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 05:58:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 3356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:59:02.995469 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-16bddbd1-8893-4ad6-bca9-18afd8361ee0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:02.997695 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-16bddbd1-8893-4ad6-bca9-18afd8361ee0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:03.028882 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-16bddbd1-8893-4ad6-bca9-18afd8361ee0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:03.031295 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-16bddbd1-8893-4ad6-bca9-18afd8361ee0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:03.031295 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-16bddbd1-8893-4ad6-bca9-18afd8361ee0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:03.031295 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-16bddbd1-8893-4ad6-bca9-18afd8361ee0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:03.053679 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-deef45a1-aa58-43e4-8641-1f7c3ec95db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Flavor limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:59:03.054188 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-deef45a1-aa58-43e4-8641-1f7c3ec95db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Image limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:59:03.054747 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-deef45a1-aa58-43e4-8641-1f7c3ec95db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Flavor pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:59:03.055220 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-deef45a1-aa58-43e4-8641-1f7c3ec95db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Image pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:59:03.055634 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-deef45a1-aa58-43e4-8641-1f7c3ec95db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:59:03.077518 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-deef45a1-aa58-43e4-8641-1f7c3ec95db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:03.077814 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-deef45a1-aa58-43e4-8641-1f7c3ec95db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:03.079284 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-deef45a1-aa58-43e4-8641-1f7c3ec95db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:03.079799 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-deef45a1-aa58-43e4-8641-1f7c3ec95db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:03.142078 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-deef45a1-aa58-43e4-8641-1f7c3ec95db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Getting quotas for project d45136a1cdbf4e93b9cf71d33443220f. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:59:03.157258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-deef45a1-aa58-43e4-8641-1f7c3ec95db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Getting quotas for user 7f269cd38f734209ba0496cf70469608 and project d45136a1cdbf4e93b9cf71d33443220f. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:59:03.172553 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-deef45a1-aa58-43e4-8641-1f7c3ec95db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Going to run 1 instances... {{(pid=130162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:59:03.175852 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-deef45a1-aa58-43e4-8641-1f7c3ec95db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfffd6ef-7f99-4a99-90f3-027fe9c89821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:59:03.437806 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-deef45a1-aa58-43e4-8641-1f7c3ec95db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.531762 Jul 25 05:59:03.442712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 15/36] 10.222.0.17 () {62 vars in 1187 bytes} [Mon Jul 25 05:59:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 2538 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 05:59:03.453686 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0304ea05-1f07-4e07-a59b-f97d60c60955 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:03.479581 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0304ea05-1f07-4e07-a59b-f97d60c60955 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:03.498135 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0304ea05-1f07-4e07-a59b-f97d60c60955 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:03.507814 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0304ea05-1f07-4e07-a59b-f97d60c60955 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:03.507814 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0304ea05-1f07-4e07-a59b-f97d60c60955 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:03.507814 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0304ea05-1f07-4e07-a59b-f97d60c60955 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:03.663496 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0304ea05-1f07-4e07-a59b-f97d60c60955 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:03.689294 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0304ea05-1f07-4e07-a59b-f97d60c60955 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1279 microversion: 2.1 time: 0.240203 Jul 25 05:59:03.691381 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 16/37] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:03 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1279 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:03.709441 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-08198cf9-3864-41e5-b7a3-23277ae5488d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:03.716591 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-08198cf9-3864-41e5-b7a3-23277ae5488d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:03.862062 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-16bddbd1-8893-4ad6-bca9-18afd8361ee0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:03.920408 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-16bddbd1-8893-4ad6-bca9-18afd8361ee0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1273 microversion: 2.1 time: 0.936061 Jul 25 05:59:03.932563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 22/38] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:02 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1273 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:03.961017 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d84aa046-1e69-4c52-9d52-fef4b15b37ef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:03.963633 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d84aa046-1e69-4c52-9d52-fef4b15b37ef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:04.415084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-08198cf9-3864-41e5-b7a3-23277ae5488d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:04.424038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-08198cf9-3864-41e5-b7a3-23277ae5488d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1241 microversion: 2.1 time: 0.726171 Jul 25 05:59:04.428512 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 17/39] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:03 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1241 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:04.442536 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e58b7f92-eb20-4d19-88fd-4981d56118d4 tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] Calling method '.version_select at 0x7f9d36cb8e50>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:04.656766 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e58b7f92-eb20-4d19-88fd-4981d56118d4 tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b7378d0a-a476-41ff-9bce-6fc35b23da71" status: 200 len: 351 microversion: 2.1 time: 0.226622 Jul 25 05:59:04.657726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 18/40] 10.222.0.17 () {58 vars in 1244 bytes} [Mon Jul 25 05:59:04 2022] GET /compute/v2.1/os-volumes/b7378d0a-a476-41ff-9bce-6fc35b23da71 => generated 351 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:04.718164 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e8f8a2cc-e378-4a4b-9585-7c9b38e3118e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:04.719508 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e8f8a2cc-e378-4a4b-9585-7c9b38e3118e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:04.738040 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e8f8a2cc-e378-4a4b-9585-7c9b38e3118e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:04.744184 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e8f8a2cc-e378-4a4b-9585-7c9b38e3118e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:04.745359 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e8f8a2cc-e378-4a4b-9585-7c9b38e3118e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:04.746111 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e8f8a2cc-e378-4a4b-9585-7c9b38e3118e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:04.773558 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d84aa046-1e69-4c52-9d52-fef4b15b37ef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:04.792203 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d84aa046-1e69-4c52-9d52-fef4b15b37ef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:04.819892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d84aa046-1e69-4c52-9d52-fef4b15b37ef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:04.833559 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d84aa046-1e69-4c52-9d52-fef4b15b37ef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1280 microversion: 2.20 time: 0.886711 Jul 25 05:59:04.833559 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 23/41] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:03 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1280 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:04.936538 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-eac4a6c3-3052-4649-b4b8-dccf5df214e9 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:04.937212 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-eac4a6c3-3052-4649-b4b8-dccf5df214e9 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:04.961409 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-eac4a6c3-3052-4649-b4b8-dccf5df214e9 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:04.961409 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-eac4a6c3-3052-4649-b4b8-dccf5df214e9 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:04.962185 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-eac4a6c3-3052-4649-b4b8-dccf5df214e9 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:04.963933 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-eac4a6c3-3052-4649-b4b8-dccf5df214e9 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:05.364750 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-eac4a6c3-3052-4649-b4b8-dccf5df214e9 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:05.377553 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-eac4a6c3-3052-4649-b4b8-dccf5df214e9 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1273 microversion: 2.1 time: 0.445227 Jul 25 05:59:05.390102 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 24/42] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:04 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1273 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:05.399902 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-011c5e93-15de-493d-bb3e-03147a4b3932 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1090427127", "imageRef": "bfffd6ef-7f99-4a99-90f3-027fe9c89821", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6caf91fe-f37c-45ab-b227-102d6cd92b3d"}], "security_groups": [{"name": "tempest-securitygroup--1101242534"}], "key_name": "tempest-keypair-1253193146", "user_data": "}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:05.651909 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e8f8a2cc-e378-4a4b-9585-7c9b38e3118e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:05.666540 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e8f8a2cc-e378-4a4b-9585-7c9b38e3118e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.960774 Jul 25 05:59:05.667473 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 19/43] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:04 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:05.682757 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-c7861096-9ba7-4495-8e57-96b4d21006a8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:05.684544 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-c7861096-9ba7-4495-8e57-96b4d21006a8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:05.711274 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c7861096-9ba7-4495-8e57-96b4d21006a8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:05.713918 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c7861096-9ba7-4495-8e57-96b4d21006a8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:05.716095 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c7861096-9ba7-4495-8e57-96b4d21006a8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:05.716566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c7861096-9ba7-4495-8e57-96b4d21006a8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:05.777106 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.network.neutron [None req-011c5e93-15de-493d-bb3e-03147a4b3932 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] validate_networks() for [('6caf91fe-f37c-45ab-b227-102d6cd92b3d', None, None, None, None, None)] {{(pid=130163) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:59:05.915326 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-c7861096-9ba7-4495-8e57-96b4d21006a8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:05.927661 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-c7861096-9ba7-4495-8e57-96b4d21006a8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1237 microversion: 2.1 time: 0.254873 Jul 25 05:59:05.953932 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 20/44] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:05 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1237 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:05.967483 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ebdaba1f-6806-4d9c-b949-dfe6a1ba1196 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:05.979788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ebdaba1f-6806-4d9c-b949-dfe6a1ba1196 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:05.995278 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ebdaba1f-6806-4d9c-b949-dfe6a1ba1196 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:06.004636 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ebdaba1f-6806-4d9c-b949-dfe6a1ba1196 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:06.005918 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ebdaba1f-6806-4d9c-b949-dfe6a1ba1196 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:06.006617 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ebdaba1f-6806-4d9c-b949-dfe6a1ba1196 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:06.252930 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ebdaba1f-6806-4d9c-b949-dfe6a1ba1196 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:06.280567 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ebdaba1f-6806-4d9c-b949-dfe6a1ba1196 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:06.285929 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ebdaba1f-6806-4d9c-b949-dfe6a1ba1196 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:06.287529 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ebdaba1f-6806-4d9c-b949-dfe6a1ba1196 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1276 microversion: 2.20 time: 0.331906 Jul 25 05:59:06.291491 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 21/45] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:05 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1276 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:06.400101 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1413326c-f9f0-4c76-a58e-94e3a81427fa tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:06.400101 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1413326c-f9f0-4c76-a58e-94e3a81427fa tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:06.404285 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1413326c-f9f0-4c76-a58e-94e3a81427fa tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:06.404736 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1413326c-f9f0-4c76-a58e-94e3a81427fa tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:06.405566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1413326c-f9f0-4c76-a58e-94e3a81427fa tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:06.406029 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1413326c-f9f0-4c76-a58e-94e3a81427fa tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:07.216506 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1413326c-f9f0-4c76-a58e-94e3a81427fa tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:07.252366 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1413326c-f9f0-4c76-a58e-94e3a81427fa tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.859360 Jul 25 05:59:07.263325 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 22/46] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:06 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:07.288283 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b02a78cc-0aa0-4484-814e-43e3888e9ec0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:07.291619 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b02a78cc-0aa0-4484-814e-43e3888e9ec0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:07.309763 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b02a78cc-0aa0-4484-814e-43e3888e9ec0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:07.312458 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b02a78cc-0aa0-4484-814e-43e3888e9ec0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:07.314578 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b02a78cc-0aa0-4484-814e-43e3888e9ec0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:07.317131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b02a78cc-0aa0-4484-814e-43e3888e9ec0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:07.976442 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b02a78cc-0aa0-4484-814e-43e3888e9ec0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:07.992420 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b02a78cc-0aa0-4484-814e-43e3888e9ec0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.722624 Jul 25 05:59:07.996330 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 23/47] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:07 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:08.013599 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-829e40ca-d420-474c-a008-d728f2f7a502 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:08.015972 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-829e40ca-d420-474c-a008-d728f2f7a502 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:08.035519 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-829e40ca-d420-474c-a008-d728f2f7a502 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:08.036160 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-829e40ca-d420-474c-a008-d728f2f7a502 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:08.037867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-829e40ca-d420-474c-a008-d728f2f7a502 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:08.038487 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-829e40ca-d420-474c-a008-d728f2f7a502 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:08.349661 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-829e40ca-d420-474c-a008-d728f2f7a502 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:08.362501 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-829e40ca-d420-474c-a008-d728f2f7a502 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1299 microversion: 2.1 time: 0.363990 Jul 25 05:59:08.368989 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-011c5e93-15de-493d-bb3e-03147a4b3932 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Flavor limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:59:08.370013 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-011c5e93-15de-493d-bb3e-03147a4b3932 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Image limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:59:08.370694 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-011c5e93-15de-493d-bb3e-03147a4b3932 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Flavor pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:59:08.374216 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-011c5e93-15de-493d-bb3e-03147a4b3932 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Image pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:59:08.374216 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-011c5e93-15de-493d-bb3e-03147a4b3932 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:59:08.387475 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 24/48] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:07 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1299 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:08.396479 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-011c5e93-15de-493d-bb3e-03147a4b3932 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:08.398805 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-233459b3-eb0d-45c6-ae87-38442b840d32 tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] Calling method '.version_select at 0x7f9d36cb8040>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:08.399537 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-011c5e93-15de-493d-bb3e-03147a4b3932 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:08.400586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-011c5e93-15de-493d-bb3e-03147a4b3932 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:08.423105 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-011c5e93-15de-493d-bb3e-03147a4b3932 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:08.507742 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-011c5e93-15de-493d-bb3e-03147a4b3932 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Getting quotas for project 15678135086b4a5c83eefece6cb8f79a. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:59:08.523408 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-011c5e93-15de-493d-bb3e-03147a4b3932 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Getting quotas for user dc8b3ecc32c14e31b55156586129a40c and project 15678135086b4a5c83eefece6cb8f79a. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:59:08.553127 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-233459b3-eb0d-45c6-ae87-38442b840d32 tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/9e715ade-4555-475a-bea2-70481e46d584" status: 200 len: 350 microversion: 2.1 time: 0.164185 Jul 25 05:59:08.558634 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 25/49] 10.222.0.17 () {58 vars in 1244 bytes} [Mon Jul 25 05:59:08 2022] GET /compute/v2.1/os-volumes/9e715ade-4555-475a-bea2-70481e46d584 => generated 350 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:08.558634 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3ecb541d-52d3-4a01-a4fb-cb6460a4dd6d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:08.559195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3ecb541d-52d3-4a01-a4fb-cb6460a4dd6d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:08.578507 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3ecb541d-52d3-4a01-a4fb-cb6460a4dd6d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:08.590343 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:08.590508 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3ecb541d-52d3-4a01-a4fb-cb6460a4dd6d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:08.590593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-011c5e93-15de-493d-bb3e-03147a4b3932 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Going to run 1 instances... {{(pid=130163) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:59:08.590682 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3ecb541d-52d3-4a01-a4fb-cb6460a4dd6d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:08.590682 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3ecb541d-52d3-4a01-a4fb-cb6460a4dd6d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:08.594776 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-011c5e93-15de-493d-bb3e-03147a4b3932 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfffd6ef-7f99-4a99-90f3-027fe9c89821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:59:08.926949 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-011c5e93-15de-493d-bb3e-03147a4b3932 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.527308 Jul 25 05:59:08.928237 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 25/50] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 05:59:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 3538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:59:08.935362 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-81d7838c-a00a-457c-85eb-038ed87dbebf tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:08.940875 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-81d7838c-a00a-457c-85eb-038ed87dbebf tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:08.955784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-81d7838c-a00a-457c-85eb-038ed87dbebf tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:08.956239 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-81d7838c-a00a-457c-85eb-038ed87dbebf tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:08.961918 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-81d7838c-a00a-457c-85eb-038ed87dbebf tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:08.962658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-81d7838c-a00a-457c-85eb-038ed87dbebf tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:09.308657 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3ecb541d-52d3-4a01-a4fb-cb6460a4dd6d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:09.318355 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3ecb541d-52d3-4a01-a4fb-cb6460a4dd6d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:09.328188 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3ecb541d-52d3-4a01-a4fb-cb6460a4dd6d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:09.339269 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3ecb541d-52d3-4a01-a4fb-cb6460a4dd6d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1338 microversion: 2.20 time: 0.774603 Jul 25 05:59:09.340352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 26/51] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:08 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1338 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:09.366811 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2ea6c1ed-3eaf-42bf-acc0-eb78e247b4f2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:09.369097 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2ea6c1ed-3eaf-42bf-acc0-eb78e247b4f2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:09.610637 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-81d7838c-a00a-457c-85eb-038ed87dbebf tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:09.627515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-81d7838c-a00a-457c-85eb-038ed87dbebf tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.696230 Jul 25 05:59:09.630739 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 26/52] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:08 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:09.649997 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2e2f0876-b330-4c53-8753-c34cd8680d03 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:09.650683 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2e2f0876-b330-4c53-8753-c34cd8680d03 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:09.670529 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2e2f0876-b330-4c53-8753-c34cd8680d03 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:09.674316 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2e2f0876-b330-4c53-8753-c34cd8680d03 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:09.678277 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2e2f0876-b330-4c53-8753-c34cd8680d03 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:09.680674 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2e2f0876-b330-4c53-8753-c34cd8680d03 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:09.762499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2ea6c1ed-3eaf-42bf-acc0-eb78e247b4f2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:09.795936 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2ea6c1ed-3eaf-42bf-acc0-eb78e247b4f2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1238 microversion: 2.1 time: 0.447215 Jul 25 05:59:09.811696 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 27/53] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:09 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1238 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:09.839147 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-df6d926c-1ff9-4980-b76e-78de14530758 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:09.841422 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-df6d926c-1ff9-4980-b76e-78de14530758 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:09.856369 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-df6d926c-1ff9-4980-b76e-78de14530758 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:09.856369 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-df6d926c-1ff9-4980-b76e-78de14530758 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:09.856369 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-df6d926c-1ff9-4980-b76e-78de14530758 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:09.856369 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-df6d926c-1ff9-4980-b76e-78de14530758 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:10.115302 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-df6d926c-1ff9-4980-b76e-78de14530758 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:10.147827 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-df6d926c-1ff9-4980-b76e-78de14530758 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1299 microversion: 2.1 time: 0.325952 Jul 25 05:59:10.159665 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 28/54] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:09 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1299 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:10.366262 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cea0f80f-ce00-42d3-a406-a6f521d4c1e1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:10.377830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-cea0f80f-ce00-42d3-a406-a6f521d4c1e1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:10.392744 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cea0f80f-ce00-42d3-a406-a6f521d4c1e1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:10.400188 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cea0f80f-ce00-42d3-a406-a6f521d4c1e1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:10.405745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cea0f80f-ce00-42d3-a406-a6f521d4c1e1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:10.410165 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cea0f80f-ce00-42d3-a406-a6f521d4c1e1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:10.430131 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2e2f0876-b330-4c53-8753-c34cd8680d03 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:10.438776 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2e2f0876-b330-4c53-8753-c34cd8680d03 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.805923 Jul 25 05:59:10.439496 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 27/55] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:09 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:10.657430 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4c4e8d87-204b-4ecb-9527-470252b8b42b tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:10.659824 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4c4e8d87-204b-4ecb-9527-470252b8b42b tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:10.687686 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4c4e8d87-204b-4ecb-9527-470252b8b42b tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:10.690283 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4c4e8d87-204b-4ecb-9527-470252b8b42b tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:10.704033 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4c4e8d87-204b-4ecb-9527-470252b8b42b tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:10.707638 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4c4e8d87-204b-4ecb-9527-470252b8b42b tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:10.790366 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cea0f80f-ce00-42d3-a406-a6f521d4c1e1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:10.827586 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cea0f80f-ce00-42d3-a406-a6f521d4c1e1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:10.832356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cea0f80f-ce00-42d3-a406-a6f521d4c1e1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:10.847932 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-cea0f80f-ce00-42d3-a406-a6f521d4c1e1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1338 microversion: 2.20 time: 0.494278 Jul 25 05:59:10.852135 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 29/56] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:10 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1338 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:10.880055 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-af16fe5a-8254-4834-9737-da3f7e4d784e tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] Calling method '.version_select at 0x7f9d36cb8dc0>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:10.991025 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-af16fe5a-8254-4834-9737-da3f7e4d784e tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/d00e5723-2b20-4148-a01d-5da84972fe24" status: 200 len: 350 microversion: 2.1 time: 0.131284 Jul 25 05:59:10.991793 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 30/57] 10.222.0.17 () {58 vars in 1244 bytes} [Mon Jul 25 05:59:10 2022] GET /compute/v2.1/os-volumes/d00e5723-2b20-4148-a01d-5da84972fe24 => generated 350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:10.996938 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3bcd3d6f-3a1e-4bda-b9e9-3a0113a92c03 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:10.997783 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3bcd3d6f-3a1e-4bda-b9e9-3a0113a92c03 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:11.011024 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:11.016703 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3bcd3d6f-3a1e-4bda-b9e9-3a0113a92c03 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:11.017414 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3bcd3d6f-3a1e-4bda-b9e9-3a0113a92c03 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:11.023690 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3bcd3d6f-3a1e-4bda-b9e9-3a0113a92c03 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:11.024291 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4c4e8d87-204b-4ecb-9527-470252b8b42b tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:11.025067 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3bcd3d6f-3a1e-4bda-b9e9-3a0113a92c03 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:11.035299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4c4e8d87-204b-4ecb-9527-470252b8b42b tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.391928 Jul 25 05:59:11.047347 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 28/58] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:10 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:11.169046 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-ceff9309-5388-455e-a273-405bad0d51e6 req-bb5d4bb7-05e7-42f6-a236-49e870f28b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0848c502-1383-407a-94d1-b92892dff9e4", "tag": "d095699d-c625-4730-8749-c485d48d194f"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:11.191092 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-ceff9309-5388-455e-a273-405bad0d51e6 req-bb5d4bb7-05e7-42f6-a236-49e870f28b5b service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:11.196978 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-ceff9309-5388-455e-a273-405bad0d51e6 req-bb5d4bb7-05e7-42f6-a236-49e870f28b5b service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:11.245004 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-ceff9309-5388-455e-a273-405bad0d51e6 req-bb5d4bb7-05e7-42f6-a236-49e870f28b5b service nova] Creating event network-changed:d095699d-c625-4730-8749-c485d48d194f for instance 0848c502-1383-407a-94d1-b92892dff9e4 on hv-cinder-85083 Jul 25 05:59:11.245771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-ceff9309-5388-455e-a273-405bad0d51e6 req-bb5d4bb7-05e7-42f6-a236-49e870f28b5b service nova] Acquired lock "compute-rpcapi-router" {{(pid=130163) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 05:59:11.247192 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-98e24f54-ae36-4eb4-a0cc-0c9d31e01a63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:11.247971 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-98e24f54-ae36-4eb4-a0cc-0c9d31e01a63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:11.249063 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-98e24f54-ae36-4eb4-a0cc-0c9d31e01a63 None None] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:11.249930 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-98e24f54-ae36-4eb4-a0cc-0c9d31e01a63 None None] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:11.262058 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.compute.rpcapi [None req-98e24f54-ae36-4eb4-a0cc-0c9d31e01a63 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 05:59:11.263229 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-98e24f54-ae36-4eb4-a0cc-0c9d31e01a63 None None] Releasing lock "compute-rpcapi-router" {{(pid=130163) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 05:59:11.289027 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-98e24f54-ae36-4eb4-a0cc-0c9d31e01a63 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240373 Jul 25 05:59:11.290118 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 29/59] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 05:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:11.308047 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-768b3eaa-75f9-4569-b068-157285651c39 tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] Calling method '.version_select at 0x7f9d364af790>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:11.442216 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-768b3eaa-75f9-4569-b068-157285651c39 tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.147443 Jul 25 05:59:11.443063 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 30/60] 10.222.0.17 () {58 vars in 1133 bytes} [Mon Jul 25 05:59:11 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:11.456155 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-fc0b67b9-22cf-4d96-a5aa-28eb311eb3af tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:11.457107 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-fc0b67b9-22cf-4d96-a5aa-28eb311eb3af tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:11.465514 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fc0b67b9-22cf-4d96-a5aa-28eb311eb3af tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:11.466226 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fc0b67b9-22cf-4d96-a5aa-28eb311eb3af tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:11.467368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fc0b67b9-22cf-4d96-a5aa-28eb311eb3af tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:11.467953 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fc0b67b9-22cf-4d96-a5aa-28eb311eb3af tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:11.534083 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3bcd3d6f-3a1e-4bda-b9e9-3a0113a92c03 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:11.545680 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3bcd3d6f-3a1e-4bda-b9e9-3a0113a92c03 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1242 microversion: 2.1 time: 0.552720 Jul 25 05:59:11.550379 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 31/61] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:10 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1242 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:11.582286 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-36d9f352-3421-416f-8469-1547e9b61138 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:11.583929 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-36d9f352-3421-416f-8469-1547e9b61138 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:11.600773 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-36d9f352-3421-416f-8469-1547e9b61138 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:11.604309 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-36d9f352-3421-416f-8469-1547e9b61138 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:11.606001 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-36d9f352-3421-416f-8469-1547e9b61138 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:11.607326 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-36d9f352-3421-416f-8469-1547e9b61138 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:11.634375 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-fc0b67b9-22cf-4d96-a5aa-28eb311eb3af tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:11.643708 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-fc0b67b9-22cf-4d96-a5aa-28eb311eb3af tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.199286 Jul 25 05:59:11.646466 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 31/62] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:11 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:11.652584 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a85b8b66-a863-4d87-b176-69a6ebc7e952 tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] Calling method '.version_select at 0x7f9d364af160>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:11.763988 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a85b8b66-a863-4d87-b176-69a6ebc7e952 tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.116099 Jul 25 05:59:11.765930 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 32/63] 10.222.0.17 () {58 vars in 1148 bytes} [Mon Jul 25 05:59:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:11.779247 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-1e186eb8-d79a-4c56-83ec-1ea1b426d7f9 tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] Calling method '.version_select at 0x7f9d3643faf0>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:11.879977 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-1e186eb8-d79a-4c56-83ec-1ea1b426d7f9 tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.106278 Jul 25 05:59:11.881348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 33/64] 10.222.0.17 () {58 vars in 1133 bytes} [Mon Jul 25 05:59:11 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:11.956869 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-36d9f352-3421-416f-8469-1547e9b61138 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:11.964653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-36d9f352-3421-416f-8469-1547e9b61138 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.410839 Jul 25 05:59:11.972429 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 32/65] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:11 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:11.986956 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1701e116-80e7-4f99-ad94-8e112e355806 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:11.989350 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1701e116-80e7-4f99-ad94-8e112e355806 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:11.998278 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1701e116-80e7-4f99-ad94-8e112e355806 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:11.999033 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1701e116-80e7-4f99-ad94-8e112e355806 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:12.000331 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1701e116-80e7-4f99-ad94-8e112e355806 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:12.001092 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1701e116-80e7-4f99-ad94-8e112e355806 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:12.044564 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-9ace324c-b8ae-4f51-a9d6-75f9f8025ff4 req-c7254fc9-8a9f-4634-bb2f-0b8285ba6489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af46a4c-7081-4329-bcb1-df497104456e", "tag": "84dfe514-aa89-4462-b8cb-4f42811b6545"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:12.055070 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-9ace324c-b8ae-4f51-a9d6-75f9f8025ff4 req-c7254fc9-8a9f-4634-bb2f-0b8285ba6489 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:12.055805 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-9ace324c-b8ae-4f51-a9d6-75f9f8025ff4 req-c7254fc9-8a9f-4634-bb2f-0b8285ba6489 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:12.067313 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-9ace324c-b8ae-4f51-a9d6-75f9f8025ff4 req-c7254fc9-8a9f-4634-bb2f-0b8285ba6489 service nova] Creating event network-changed:84dfe514-aa89-4462-b8cb-4f42811b6545 for instance 6af46a4c-7081-4329-bcb1-df497104456e on hv-cinder-85083 Jul 25 05:59:12.072978 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-9ace324c-b8ae-4f51-a9d6-75f9f8025ff4 req-c7254fc9-8a9f-4634-bb2f-0b8285ba6489 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189938 Jul 25 05:59:12.073919 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 34/66] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 05:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:12.081620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-94818292-827a-4353-b4fe-31624d9ad8dd tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] Calling method '.version_select at 0x7f9d364afb80>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:12.085528 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1701e116-80e7-4f99-ad94-8e112e355806 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:12.095561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1701e116-80e7-4f99-ad94-8e112e355806 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:12.100081 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1701e116-80e7-4f99-ad94-8e112e355806 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:12.100081 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1701e116-80e7-4f99-ad94-8e112e355806 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1338 microversion: 2.20 time: 0.125411 Jul 25 05:59:12.112293 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:11 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1338 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:12.117730 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-31d226ee-f076-43a2-a44c-b27d86dae38c tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:12.118876 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-31d226ee-f076-43a2-a44c-b27d86dae38c tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:12.128590 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-31d226ee-f076-43a2-a44c-b27d86dae38c tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:12.129567 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-31d226ee-f076-43a2-a44c-b27d86dae38c tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:12.130859 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-31d226ee-f076-43a2-a44c-b27d86dae38c tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:12.131590 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-31d226ee-f076-43a2-a44c-b27d86dae38c tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:12.168128 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=100 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:12.247065 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-94818292-827a-4353-b4fe-31624d9ad8dd tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.171640 Jul 25 05:59:12.247997 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 35/68] 10.222.0.17 () {58 vars in 1166 bytes} [Mon Jul 25 05:59:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:12.260783 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-bdb7a456-936f-4491-b5c0-f217487685b0 tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] Calling method '.version_select at 0x7f9d364e1e50>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:12.379392 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-31d226ee-f076-43a2-a44c-b27d86dae38c tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:12.388631 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-31d226ee-f076-43a2-a44c-b27d86dae38c tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.273934 Jul 25 05:59:12.389307 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 34/69] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:12 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:12.391958 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-bdb7a456-936f-4491-b5c0-f217487685b0 tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.135082 Jul 25 05:59:12.393135 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 36/70] 10.222.0.17 () {58 vars in 1169 bytes} [Mon Jul 25 05:59:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:59:12.409007 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-feb9d17d-6a80-4bf0-bb88-6e67a6f172d6 tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] Calling method '.version_select at 0x7f9d36d5d3a0>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:12.542398 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-feb9d17d-6a80-4bf0-bb88-6e67a6f172d6 tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.137584 Jul 25 05:59:12.543286 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 35/71] 10.222.0.17 () {58 vars in 1154 bytes} [Mon Jul 25 05:59:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:12.558466 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-12c746f6-8919-4b32-ac6b-a0b74d754c41 tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] Calling method '.version_select at 0x7f9d364754c0>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:12.569971 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3ef5ee9e-1630-4d06-b987-89db9cf14c32 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:12.571353 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3ef5ee9e-1630-4d06-b987-89db9cf14c32 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:12.591264 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3ef5ee9e-1630-4d06-b987-89db9cf14c32 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:12.591960 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3ef5ee9e-1630-4d06-b987-89db9cf14c32 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:12.592967 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3ef5ee9e-1630-4d06-b987-89db9cf14c32 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:12.594146 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3ef5ee9e-1630-4d06-b987-89db9cf14c32 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:12.660795 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-12c746f6-8919-4b32-ac6b-a0b74d754c41 tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.106067 Jul 25 05:59:12.661698 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 37/72] 10.222.0.17 () {58 vars in 1187 bytes} [Mon Jul 25 05:59:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:12.667126 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-91a05b55-0cd7-4523-86a8-614623756f78 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:12.667972 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-91a05b55-0cd7-4523-86a8-614623756f78 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:12.675901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-91a05b55-0cd7-4523-86a8-614623756f78 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:12.676672 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-91a05b55-0cd7-4523-86a8-614623756f78 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:12.677665 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-91a05b55-0cd7-4523-86a8-614623756f78 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:12.678195 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-91a05b55-0cd7-4523-86a8-614623756f78 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:12.684311 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3ef5ee9e-1630-4d06-b987-89db9cf14c32 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:12.692275 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3ef5ee9e-1630-4d06-b987-89db9cf14c32 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1242 microversion: 2.1 time: 0.129119 Jul 25 05:59:12.692853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 36/73] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:12 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1242 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:12.699279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a9e13bf6-a445-44b3-b5c1-87ca2763c28e tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] Calling method '.version_select at 0x7f9d36cb8310>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:12.792495 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a9e13bf6-a445-44b3-b5c1-87ca2763c28e tempest-VolumesTestJSON-974962588 tempest-VolumesTestJSON-974962588-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.096637 Jul 25 05:59:12.793065 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 37/74] 10.222.0.17 () {58 vars in 1154 bytes} [Mon Jul 25 05:59:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:12.830853 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-91a05b55-0cd7-4523-86a8-614623756f78 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:12.839934 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-91a05b55-0cd7-4523-86a8-614623756f78 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.176650 Jul 25 05:59:12.840771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 38/75] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:12 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:12.988032 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-967d9fbf-427f-4313-a8f5-a9fd869d8a1f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:12.990075 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-967d9fbf-427f-4313-a8f5-a9fd869d8a1f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:12.995394 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-967d9fbf-427f-4313-a8f5-a9fd869d8a1f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:12.996012 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-967d9fbf-427f-4313-a8f5-a9fd869d8a1f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:12.996926 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-967d9fbf-427f-4313-a8f5-a9fd869d8a1f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:12.997376 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-967d9fbf-427f-4313-a8f5-a9fd869d8a1f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:13.117230 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-03b6d347-c88e-4f38-aeaf-854a597318a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:13.117833 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-03b6d347-c88e-4f38-aeaf-854a597318a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:13.121343 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=6 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:13.125272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-03b6d347-c88e-4f38-aeaf-854a597318a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:13.125754 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-03b6d347-c88e-4f38-aeaf-854a597318a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:13.126715 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-03b6d347-c88e-4f38-aeaf-854a597318a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:13.126882 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-967d9fbf-427f-4313-a8f5-a9fd869d8a1f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:13.127324 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-03b6d347-c88e-4f38-aeaf-854a597318a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:13.135709 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-967d9fbf-427f-4313-a8f5-a9fd869d8a1f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.151478 Jul 25 05:59:13.136361 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 38/76] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:12 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:13.291700 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-03b6d347-c88e-4f38-aeaf-854a597318a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:13.303102 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-03b6d347-c88e-4f38-aeaf-854a597318a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:13.304613 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-03b6d347-c88e-4f38-aeaf-854a597318a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:13.305709 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-03b6d347-c88e-4f38-aeaf-854a597318a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.192531 Jul 25 05:59:13.306330 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 39/77] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:13 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:59:13.314768 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-c0dd9f1b-2511-416d-bde6-504610e2f678 req-48dad6ec-2caa-4219-9bd4-c5a0ffcca639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57462ad3-d5fc-4dee-9087-afc18c4f0305", "tag": "01a10501-1421-4069-8834-45e48a9bab40"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:13.326460 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-c0dd9f1b-2511-416d-bde6-504610e2f678 req-48dad6ec-2caa-4219-9bd4-c5a0ffcca639 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:13.327206 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-c0dd9f1b-2511-416d-bde6-504610e2f678 req-48dad6ec-2caa-4219-9bd4-c5a0ffcca639 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:13.351143 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-c0dd9f1b-2511-416d-bde6-504610e2f678 req-48dad6ec-2caa-4219-9bd4-c5a0ffcca639 service nova] Creating event network-changed:01a10501-1421-4069-8834-45e48a9bab40 for instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 on hv-cinder-85083 Jul 25 05:59:13.351671 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-c0dd9f1b-2511-416d-bde6-504610e2f678 req-48dad6ec-2caa-4219-9bd4-c5a0ffcca639 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130162) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 05:59:13.352760 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4e38be67-c605-4d55-94a1-0a9516f9b7a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:13.353190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4e38be67-c605-4d55-94a1-0a9516f9b7a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:13.354148 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4e38be67-c605-4d55-94a1-0a9516f9b7a9 None None] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:13.354668 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4e38be67-c605-4d55-94a1-0a9516f9b7a9 None None] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:13.368088 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.compute.rpcapi [None req-4e38be67-c605-4d55-94a1-0a9516f9b7a9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 05:59:13.369253 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4e38be67-c605-4d55-94a1-0a9516f9b7a9 None None] Releasing lock "compute-rpcapi-router" {{(pid=130162) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 05:59:13.388852 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-4e38be67-c605-4d55-94a1-0a9516f9b7a9 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079409 Jul 25 05:59:13.389699 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 39/78] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 05:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:13.407670 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5eeb03ea-de39-4aee-a60d-2e8668581f2d tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:13.412342 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5eeb03ea-de39-4aee-a60d-2e8668581f2d tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:13.420037 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5eeb03ea-de39-4aee-a60d-2e8668581f2d tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:13.420477 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5eeb03ea-de39-4aee-a60d-2e8668581f2d tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:13.421411 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5eeb03ea-de39-4aee-a60d-2e8668581f2d tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:13.422868 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5eeb03ea-de39-4aee-a60d-2e8668581f2d tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:13.589830 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5eeb03ea-de39-4aee-a60d-2e8668581f2d tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:13.598530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5eeb03ea-de39-4aee-a60d-2e8668581f2d tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.196812 Jul 25 05:59:13.608453 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 40/79] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:13 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:13.713152 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b967b9ce-dc33-4ed9-9b5c-e93cc2fdcdde tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:13.713896 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b967b9ce-dc33-4ed9-9b5c-e93cc2fdcdde tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:13.720797 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b967b9ce-dc33-4ed9-9b5c-e93cc2fdcdde tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:13.721291 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b967b9ce-dc33-4ed9-9b5c-e93cc2fdcdde tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:13.722128 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b967b9ce-dc33-4ed9-9b5c-e93cc2fdcdde tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:13.722532 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b967b9ce-dc33-4ed9-9b5c-e93cc2fdcdde tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:13.807542 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b967b9ce-dc33-4ed9-9b5c-e93cc2fdcdde tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:13.827191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b967b9ce-dc33-4ed9-9b5c-e93cc2fdcdde tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1242 microversion: 2.1 time: 0.120279 Jul 25 05:59:13.830636 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 40/80] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:13 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1242 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:13.860725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5fd27237-e5fb-4c04-bf58-ac6a27f2b7c5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:13.861338 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5fd27237-e5fb-4c04-bf58-ac6a27f2b7c5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:13.867490 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5fd27237-e5fb-4c04-bf58-ac6a27f2b7c5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:13.867956 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5fd27237-e5fb-4c04-bf58-ac6a27f2b7c5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:13.868708 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5fd27237-e5fb-4c04-bf58-ac6a27f2b7c5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:13.869457 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5fd27237-e5fb-4c04-bf58-ac6a27f2b7c5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:14.069896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5fd27237-e5fb-4c04-bf58-ac6a27f2b7c5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:14.082540 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5fd27237-e5fb-4c04-bf58-ac6a27f2b7c5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.226150 Jul 25 05:59:14.086242 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 41/81] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:13 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:14.153837 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-291682fc-455b-4999-9a9d-bdb681d7a43c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:14.154506 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-291682fc-455b-4999-9a9d-bdb681d7a43c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:14.161329 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-291682fc-455b-4999-9a9d-bdb681d7a43c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:14.162446 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-291682fc-455b-4999-9a9d-bdb681d7a43c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:14.163245 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-291682fc-455b-4999-9a9d-bdb681d7a43c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:14.163677 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-291682fc-455b-4999-9a9d-bdb681d7a43c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:14.317619 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-291682fc-455b-4999-9a9d-bdb681d7a43c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:14.329605 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-de9eb091-7d25-4330-b400-1db3d91581f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:14.330219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-de9eb091-7d25-4330-b400-1db3d91581f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:14.336229 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-291682fc-455b-4999-9a9d-bdb681d7a43c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.186580 Jul 25 05:59:14.337529 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 41/82] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:14 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:14.348334 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-de9eb091-7d25-4330-b400-1db3d91581f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:14.348786 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-de9eb091-7d25-4330-b400-1db3d91581f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:14.349577 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-de9eb091-7d25-4330-b400-1db3d91581f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:14.350016 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-de9eb091-7d25-4330-b400-1db3d91581f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:14.537976 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-de9eb091-7d25-4330-b400-1db3d91581f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:14.545777 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-de9eb091-7d25-4330-b400-1db3d91581f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:14.547859 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-de9eb091-7d25-4330-b400-1db3d91581f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:14.548980 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-de9eb091-7d25-4330-b400-1db3d91581f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.229060 Jul 25 05:59:14.549874 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 42/83] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:14 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:14.616042 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-da315539-a0bc-4801-8aee-ded2829d11db tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:14.617069 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-da315539-a0bc-4801-8aee-ded2829d11db tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:14.623509 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-da315539-a0bc-4801-8aee-ded2829d11db tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:14.628080 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-da315539-a0bc-4801-8aee-ded2829d11db tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:14.628080 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-da315539-a0bc-4801-8aee-ded2829d11db tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:14.628080 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-da315539-a0bc-4801-8aee-ded2829d11db tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:14.772834 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-da315539-a0bc-4801-8aee-ded2829d11db tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:14.781644 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-da315539-a0bc-4801-8aee-ded2829d11db tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.169042 Jul 25 05:59:14.788354 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 42/84] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:14 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:14.845033 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-1e2d10d4-d5c7-41de-8ea1-f3c7b590ca5a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:14.845997 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-1e2d10d4-d5c7-41de-8ea1-f3c7b590ca5a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:14.852662 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1e2d10d4-d5c7-41de-8ea1-f3c7b590ca5a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:14.853244 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1e2d10d4-d5c7-41de-8ea1-f3c7b590ca5a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:14.854139 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1e2d10d4-d5c7-41de-8ea1-f3c7b590ca5a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:14.854672 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1e2d10d4-d5c7-41de-8ea1-f3c7b590ca5a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:14.925087 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-1e2d10d4-d5c7-41de-8ea1-f3c7b590ca5a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:14.935361 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-1e2d10d4-d5c7-41de-8ea1-f3c7b590ca5a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1242 microversion: 2.1 time: 0.095141 Jul 25 05:59:14.937745 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 43/85] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:14 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:15.105809 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-5bfd5385-78ab-45bf-8e17-24cf10c7a9b2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:15.106723 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-5bfd5385-78ab-45bf-8e17-24cf10c7a9b2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:15.113353 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5bfd5385-78ab-45bf-8e17-24cf10c7a9b2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:15.117998 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5bfd5385-78ab-45bf-8e17-24cf10c7a9b2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:15.117998 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5bfd5385-78ab-45bf-8e17-24cf10c7a9b2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:15.117998 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5bfd5385-78ab-45bf-8e17-24cf10c7a9b2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:15.269671 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5bfd5385-78ab-45bf-8e17-24cf10c7a9b2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:15.277441 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-5bfd5385-78ab-45bf-8e17-24cf10c7a9b2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.179010 Jul 25 05:59:15.281924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 43/86] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:15 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:15.357332 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-de14aec0-7551-448e-8292-79e869e236ba tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:15.357865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-de14aec0-7551-448e-8292-79e869e236ba tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:15.364096 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-de14aec0-7551-448e-8292-79e869e236ba tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:15.364542 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-de14aec0-7551-448e-8292-79e869e236ba tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:15.365317 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-de14aec0-7551-448e-8292-79e869e236ba tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:15.365923 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-de14aec0-7551-448e-8292-79e869e236ba tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:15.527412 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-de14aec0-7551-448e-8292-79e869e236ba tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:15.535520 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-de14aec0-7551-448e-8292-79e869e236ba tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.182120 Jul 25 05:59:15.542846 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 44/87] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:15 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:15.569188 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-7bc6cea7-1106-41c2-b6ec-99024277bdcb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:15.569833 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-7bc6cea7-1106-41c2-b6ec-99024277bdcb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:15.576539 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7bc6cea7-1106-41c2-b6ec-99024277bdcb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:15.577064 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7bc6cea7-1106-41c2-b6ec-99024277bdcb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:15.580515 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7bc6cea7-1106-41c2-b6ec-99024277bdcb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:15.581396 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7bc6cea7-1106-41c2-b6ec-99024277bdcb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:15.718355 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-7bc6cea7-1106-41c2-b6ec-99024277bdcb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:15.737811 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-7bc6cea7-1106-41c2-b6ec-99024277bdcb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:15.739361 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-7bc6cea7-1106-41c2-b6ec-99024277bdcb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:15.740499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-7bc6cea7-1106-41c2-b6ec-99024277bdcb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.175609 Jul 25 05:59:15.741050 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 44/88] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:15 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:15.850920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-771c300b-4b6e-4aca-a31b-44c326142ffb tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:15.852107 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-771c300b-4b6e-4aca-a31b-44c326142ffb tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:15.861296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-771c300b-4b6e-4aca-a31b-44c326142ffb tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:15.861746 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-771c300b-4b6e-4aca-a31b-44c326142ffb tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:15.862551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-771c300b-4b6e-4aca-a31b-44c326142ffb tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:15.862987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-771c300b-4b6e-4aca-a31b-44c326142ffb tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:15.979030 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-7c78d83f-4941-4c38-8728-970c6fd60048 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:15.979030 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-7c78d83f-4941-4c38-8728-970c6fd60048 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:15.979030 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7c78d83f-4941-4c38-8728-970c6fd60048 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:15.979030 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7c78d83f-4941-4c38-8728-970c6fd60048 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:15.980113 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7c78d83f-4941-4c38-8728-970c6fd60048 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:15.980113 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7c78d83f-4941-4c38-8728-970c6fd60048 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:16.053734 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-771c300b-4b6e-4aca-a31b-44c326142ffb tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:16.054378 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-7c78d83f-4941-4c38-8728-970c6fd60048 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:16.054535 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-771c300b-4b6e-4aca-a31b-44c326142ffb tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.233744 Jul 25 05:59:16.054627 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-7c78d83f-4941-4c38-8728-970c6fd60048 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1242 microversion: 2.1 time: 0.086183 Jul 25 05:59:16.054705 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 45/89] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:15 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:16.054780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 45/90] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:15 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:16.296037 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4625e7f6-8e01-41dc-8158-551567e6bd35 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:16.296576 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4625e7f6-8e01-41dc-8158-551567e6bd35 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:16.302603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4625e7f6-8e01-41dc-8158-551567e6bd35 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:16.303052 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4625e7f6-8e01-41dc-8158-551567e6bd35 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:16.303834 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4625e7f6-8e01-41dc-8158-551567e6bd35 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:16.304268 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4625e7f6-8e01-41dc-8158-551567e6bd35 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:16.322278 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=100 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:16.434980 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4625e7f6-8e01-41dc-8158-551567e6bd35 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:16.442996 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4625e7f6-8e01-41dc-8158-551567e6bd35 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.150896 Jul 25 05:59:16.443568 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 46/91] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:16 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:16.552328 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ef3ba12f-68ca-487b-b5a4-a48a004ebbf3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:16.552944 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ef3ba12f-68ca-487b-b5a4-a48a004ebbf3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:16.559560 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ef3ba12f-68ca-487b-b5a4-a48a004ebbf3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:16.562706 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ef3ba12f-68ca-487b-b5a4-a48a004ebbf3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:16.562706 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ef3ba12f-68ca-487b-b5a4-a48a004ebbf3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:16.562706 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ef3ba12f-68ca-487b-b5a4-a48a004ebbf3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:16.768444 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-43f5b352-f878-4338-8ea9-a353b9d82719 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:16.769489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-43f5b352-f878-4338-8ea9-a353b9d82719 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:16.777030 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-43f5b352-f878-4338-8ea9-a353b9d82719 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:16.777574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-43f5b352-f878-4338-8ea9-a353b9d82719 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:16.778809 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-43f5b352-f878-4338-8ea9-a353b9d82719 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:16.779038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-43f5b352-f878-4338-8ea9-a353b9d82719 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:16.787637 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ef3ba12f-68ca-487b-b5a4-a48a004ebbf3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:16.796875 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ef3ba12f-68ca-487b-b5a4-a48a004ebbf3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.247084 Jul 25 05:59:16.807518 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 46/92] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:16 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:17.063475 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ab57fff3-4c4c-4a2e-bbab-bf5ff9e3a5b7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:17.064125 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ab57fff3-4c4c-4a2e-bbab-bf5ff9e3a5b7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:17.076099 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ab57fff3-4c4c-4a2e-bbab-bf5ff9e3a5b7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:17.076827 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ab57fff3-4c4c-4a2e-bbab-bf5ff9e3a5b7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:17.078445 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ab57fff3-4c4c-4a2e-bbab-bf5ff9e3a5b7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:17.079103 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ab57fff3-4c4c-4a2e-bbab-bf5ff9e3a5b7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:17.319287 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ab57fff3-4c4c-4a2e-bbab-bf5ff9e3a5b7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:17.326989 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-43f5b352-f878-4338-8ea9-a353b9d82719 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:17.327583 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ab57fff3-4c4c-4a2e-bbab-bf5ff9e3a5b7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1234 microversion: 2.1 time: 0.267783 Jul 25 05:59:17.336888 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 47/93] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:17 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1234 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:17.336888 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-413b1791-ffdf-4a1a-8928-21d7f1419da9 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:17.336888 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-413b1791-ffdf-4a1a-8928-21d7f1419da9 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:17.340413 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-413b1791-ffdf-4a1a-8928-21d7f1419da9 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:17.340965 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-413b1791-ffdf-4a1a-8928-21d7f1419da9 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:17.341834 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-413b1791-ffdf-4a1a-8928-21d7f1419da9 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:17.342358 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-413b1791-ffdf-4a1a-8928-21d7f1419da9 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:17.346845 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-43f5b352-f878-4338-8ea9-a353b9d82719 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:17.348354 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-43f5b352-f878-4338-8ea9-a353b9d82719 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:17.360212 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-43f5b352-f878-4338-8ea9-a353b9d82719 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.591570 Jul 25 05:59:17.360212 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 47/94] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:16 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:17.460651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-575fecfd-d303-4b90-98d5-6240964af7f7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:17.461389 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-575fecfd-d303-4b90-98d5-6240964af7f7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:17.470092 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-575fecfd-d303-4b90-98d5-6240964af7f7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:17.470982 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-575fecfd-d303-4b90-98d5-6240964af7f7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:17.472589 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-575fecfd-d303-4b90-98d5-6240964af7f7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:17.472589 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-575fecfd-d303-4b90-98d5-6240964af7f7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:17.955519 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-575fecfd-d303-4b90-98d5-6240964af7f7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:17.971906 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-575fecfd-d303-4b90-98d5-6240964af7f7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.515625 Jul 25 05:59:17.976917 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 48/95] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:17 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:17.996030 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2e9581f0-1606-4d16-958b-f0883d897109 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:17.997213 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2e9581f0-1606-4d16-958b-f0883d897109 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:18.006346 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2e9581f0-1606-4d16-958b-f0883d897109 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:18.012052 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2e9581f0-1606-4d16-958b-f0883d897109 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:18.012052 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2e9581f0-1606-4d16-958b-f0883d897109 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:18.012052 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2e9581f0-1606-4d16-958b-f0883d897109 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:18.046136 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-413b1791-ffdf-4a1a-8928-21d7f1419da9 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:18.054767 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-413b1791-ffdf-4a1a-8928-21d7f1419da9 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.725254 Jul 25 05:59:18.055696 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 48/96] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:17 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:18.310354 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2e9581f0-1606-4d16-958b-f0883d897109 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:18.328193 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2e9581f0-1606-4d16-958b-f0883d897109 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.349304 Jul 25 05:59:18.329830 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 49/97] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:17 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:18.355970 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6d3b3ffc-3792-4a1e-a457-77399e2dd763 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:18.356597 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-6d3b3ffc-3792-4a1e-a457-77399e2dd763 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:18.373937 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6d3b3ffc-3792-4a1e-a457-77399e2dd763 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:18.375370 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6d3b3ffc-3792-4a1e-a457-77399e2dd763 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:18.382189 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6d3b3ffc-3792-4a1e-a457-77399e2dd763 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:18.382189 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6d3b3ffc-3792-4a1e-a457-77399e2dd763 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:18.383177 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5b48d217-75ef-4eaf-9f1b-cd1816b27264 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:18.383177 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5b48d217-75ef-4eaf-9f1b-cd1816b27264 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:18.388982 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5b48d217-75ef-4eaf-9f1b-cd1816b27264 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:18.389521 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5b48d217-75ef-4eaf-9f1b-cd1816b27264 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:18.390990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5b48d217-75ef-4eaf-9f1b-cd1816b27264 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:18.391516 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5b48d217-75ef-4eaf-9f1b-cd1816b27264 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:18.564044 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-6d3b3ffc-3792-4a1e-a457-77399e2dd763 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:18.577659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-6d3b3ffc-3792-4a1e-a457-77399e2dd763 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1296 microversion: 2.1 time: 0.230719 Jul 25 05:59:18.578506 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=36 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:18.578774 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 49/98] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:18 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1296 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:18.653061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5b48d217-75ef-4eaf-9f1b-cd1816b27264 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:18.665625 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5b48d217-75ef-4eaf-9f1b-cd1816b27264 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:18.672212 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5b48d217-75ef-4eaf-9f1b-cd1816b27264 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:18.672212 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5b48d217-75ef-4eaf-9f1b-cd1816b27264 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.304853 Jul 25 05:59:18.672212 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 50/99] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:18 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:59:18.962361 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-e2e8a775-bd51-46a3-af51-e4711b9c5fee req-62ade857-662b-4556-9788-0cc4dba96292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "348f256d-41e5-47d8-b165-cad6dfcd0be9", "tag": "f9f7f9cc-3fd7-49f4-b8f2-59f247cf93e3"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:18.986231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-e2e8a775-bd51-46a3-af51-e4711b9c5fee req-62ade857-662b-4556-9788-0cc4dba96292 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:18.987506 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-e2e8a775-bd51-46a3-af51-e4711b9c5fee req-62ade857-662b-4556-9788-0cc4dba96292 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:18.991627 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6392c660-a54e-411e-9914-89d0d45bcac3 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:18.992667 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6392c660-a54e-411e-9914-89d0d45bcac3 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:19.007919 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6392c660-a54e-411e-9914-89d0d45bcac3 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:19.010226 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6392c660-a54e-411e-9914-89d0d45bcac3 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:19.010226 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6392c660-a54e-411e-9914-89d0d45bcac3 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:19.011121 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6392c660-a54e-411e-9914-89d0d45bcac3 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:19.013550 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-e2e8a775-bd51-46a3-af51-e4711b9c5fee req-62ade857-662b-4556-9788-0cc4dba96292 service nova] Creating event network-changed:f9f7f9cc-3fd7-49f4-b8f2-59f247cf93e3 for instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 on hv-cinder-85083 Jul 25 05:59:19.024408 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-e2e8a775-bd51-46a3-af51-e4711b9c5fee req-62ade857-662b-4556-9788-0cc4dba96292 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065454 Jul 25 05:59:19.026087 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 50/100] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 05:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:19.081602 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-7b1dcbac-1cb2-4c68-90a6-20f42c3f2dc6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:19.085487 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-7b1dcbac-1cb2-4c68-90a6-20f42c3f2dc6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:19.118129 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7b1dcbac-1cb2-4c68-90a6-20f42c3f2dc6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:19.118794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7b1dcbac-1cb2-4c68-90a6-20f42c3f2dc6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:19.119741 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7b1dcbac-1cb2-4c68-90a6-20f42c3f2dc6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:19.120265 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7b1dcbac-1cb2-4c68-90a6-20f42c3f2dc6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:19.214813 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6392c660-a54e-411e-9914-89d0d45bcac3 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:19.224514 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6392c660-a54e-411e-9914-89d0d45bcac3 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.238443 Jul 25 05:59:19.225259 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 51/101] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:18 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:19.345780 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b0314c2c-aa91-430e-9b25-6bc8a26d2579 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:19.346690 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b0314c2c-aa91-430e-9b25-6bc8a26d2579 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:19.353334 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b0314c2c-aa91-430e-9b25-6bc8a26d2579 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:19.353817 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b0314c2c-aa91-430e-9b25-6bc8a26d2579 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:19.354846 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b0314c2c-aa91-430e-9b25-6bc8a26d2579 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:19.355273 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b0314c2c-aa91-430e-9b25-6bc8a26d2579 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:19.582854 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b0314c2c-aa91-430e-9b25-6bc8a26d2579 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:19.594394 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-7b1dcbac-1cb2-4c68-90a6-20f42c3f2dc6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:19.600283 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b0314c2c-aa91-430e-9b25-6bc8a26d2579 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.258911 Jul 25 05:59:19.601290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 52/102] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:19 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:19.604841 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-7b1dcbac-1cb2-4c68-90a6-20f42c3f2dc6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.534631 Jul 25 05:59:19.606738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 51/103] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:19 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:19.619469 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2bced81d-7d14-4f4c-9d2d-981acf96dbf7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:19.620088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2bced81d-7d14-4f4c-9d2d-981acf96dbf7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:19.630610 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2bced81d-7d14-4f4c-9d2d-981acf96dbf7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:19.631008 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2bced81d-7d14-4f4c-9d2d-981acf96dbf7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:19.632176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2bced81d-7d14-4f4c-9d2d-981acf96dbf7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:19.635911 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2bced81d-7d14-4f4c-9d2d-981acf96dbf7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:19.690004 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-105128d0-2ce8-40c5-8184-cbcd162f45c3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:19.696651 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-105128d0-2ce8-40c5-8184-cbcd162f45c3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:19.698130 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-105128d0-2ce8-40c5-8184-cbcd162f45c3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:19.698773 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-105128d0-2ce8-40c5-8184-cbcd162f45c3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:19.699562 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-105128d0-2ce8-40c5-8184-cbcd162f45c3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:19.700018 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-105128d0-2ce8-40c5-8184-cbcd162f45c3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:19.710164 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2bced81d-7d14-4f4c-9d2d-981acf96dbf7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:19.721513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2bced81d-7d14-4f4c-9d2d-981acf96dbf7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1296 microversion: 2.1 time: 0.118891 Jul 25 05:59:19.725360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 53/104] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:19 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1296 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:19.769237 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=28 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:19.934433 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-105128d0-2ce8-40c5-8184-cbcd162f45c3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:19.944003 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-105128d0-2ce8-40c5-8184-cbcd162f45c3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:19.945526 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-105128d0-2ce8-40c5-8184-cbcd162f45c3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:19.950661 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-105128d0-2ce8-40c5-8184-cbcd162f45c3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.263387 Jul 25 05:59:19.951513 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 52/105] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:19 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:59:20.253179 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7dfcc18f-acb7-47d7-bcf4-fc6be845540c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:20.255774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7dfcc18f-acb7-47d7-bcf4-fc6be845540c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:20.263581 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7dfcc18f-acb7-47d7-bcf4-fc6be845540c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:20.264156 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7dfcc18f-acb7-47d7-bcf4-fc6be845540c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:20.265121 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7dfcc18f-acb7-47d7-bcf4-fc6be845540c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:20.266239 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7dfcc18f-acb7-47d7-bcf4-fc6be845540c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:20.415221 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7dfcc18f-acb7-47d7-bcf4-fc6be845540c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:20.422939 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-7dfcc18f-acb7-47d7-bcf4-fc6be845540c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.184162 Jul 25 05:59:20.423735 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 54/106] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:20 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:20.620739 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-4299fdaa-c1fa-4bb9-9643-dca53ef55740 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:20.621372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-4299fdaa-c1fa-4bb9-9643-dca53ef55740 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:20.622837 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ef613007-7e22-4e82-9575-f056241d3437 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:20.623447 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ef613007-7e22-4e82-9575-f056241d3437 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:20.631001 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4299fdaa-c1fa-4bb9-9643-dca53ef55740 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:20.631001 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4299fdaa-c1fa-4bb9-9643-dca53ef55740 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:20.631245 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ef613007-7e22-4e82-9575-f056241d3437 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:20.631345 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4299fdaa-c1fa-4bb9-9643-dca53ef55740 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:20.631435 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ef613007-7e22-4e82-9575-f056241d3437 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:20.631616 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4299fdaa-c1fa-4bb9-9643-dca53ef55740 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:20.631714 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ef613007-7e22-4e82-9575-f056241d3437 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:20.631714 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ef613007-7e22-4e82-9575-f056241d3437 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:20.783226 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ef613007-7e22-4e82-9575-f056241d3437 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:20.791236 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ef613007-7e22-4e82-9575-f056241d3437 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.172051 Jul 25 05:59:20.792084 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 55/107] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:20 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:20.801224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-acafccae-428b-4209-be0a-f3292c6321bb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:20.802073 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-acafccae-428b-4209-be0a-f3292c6321bb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:20.812970 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-acafccae-428b-4209-be0a-f3292c6321bb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:20.813411 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-acafccae-428b-4209-be0a-f3292c6321bb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:20.814184 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-acafccae-428b-4209-be0a-f3292c6321bb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:20.814652 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-acafccae-428b-4209-be0a-f3292c6321bb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:21.096188 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-acafccae-428b-4209-be0a-f3292c6321bb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:21.104632 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-acafccae-428b-4209-be0a-f3292c6321bb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1364 microversion: 2.1 time: 0.311385 Jul 25 05:59:21.105218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 56/108] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:20 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1364 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:21.119871 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3b0dc6af-b137-4c3f-99a1-173dd637689c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:21.120839 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-3b0dc6af-b137-4c3f-99a1-173dd637689c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:21.127670 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3b0dc6af-b137-4c3f-99a1-173dd637689c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:21.128493 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3b0dc6af-b137-4c3f-99a1-173dd637689c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:21.129461 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3b0dc6af-b137-4c3f-99a1-173dd637689c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:21.130090 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3b0dc6af-b137-4c3f-99a1-173dd637689c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:21.259328 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=8 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:21.291970 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4299fdaa-c1fa-4bb9-9643-dca53ef55740 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:21.311924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-4299fdaa-c1fa-4bb9-9643-dca53ef55740 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.694849 Jul 25 05:59:21.312542 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 53/109] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:20 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:21.317783 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-5c795663-4a0d-427e-8f0d-9ebfdea5a825 req-f057385f-aaaf-4b42-bdcc-bc732e6517a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "479a7885-4c31-448b-8d0d-42049d47896f", "tag": "70a76596-074b-4a73-b7c5-338b9b7a51d2"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:21.335482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-5c795663-4a0d-427e-8f0d-9ebfdea5a825 req-f057385f-aaaf-4b42-bdcc-bc732e6517a6 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:21.335996 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-5c795663-4a0d-427e-8f0d-9ebfdea5a825 req-f057385f-aaaf-4b42-bdcc-bc732e6517a6 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:21.351554 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=100 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:21.353467 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-5c795663-4a0d-427e-8f0d-9ebfdea5a825 req-f057385f-aaaf-4b42-bdcc-bc732e6517a6 service nova] Creating event network-changed:70a76596-074b-4a73-b7c5-338b9b7a51d2 for instance 479a7885-4c31-448b-8d0d-42049d47896f on hv-cinder-85083 Jul 25 05:59:21.358837 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-5c795663-4a0d-427e-8f0d-9ebfdea5a825 req-f057385f-aaaf-4b42-bdcc-bc732e6517a6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044652 Jul 25 05:59:21.359789 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 54/110] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 05:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:21.441040 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-4a469a2c-05c0-4e92-a48c-6a3f46e410a9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:21.477645 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-4a469a2c-05c0-4e92-a48c-6a3f46e410a9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:21.477645 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4a469a2c-05c0-4e92-a48c-6a3f46e410a9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:21.477645 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4a469a2c-05c0-4e92-a48c-6a3f46e410a9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:21.477645 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4a469a2c-05c0-4e92-a48c-6a3f46e410a9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:21.478127 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4a469a2c-05c0-4e92-a48c-6a3f46e410a9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:21.531589 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3b0dc6af-b137-4c3f-99a1-173dd637689c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:21.540754 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3b0dc6af-b137-4c3f-99a1-173dd637689c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:21.542386 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3b0dc6af-b137-4c3f-99a1-173dd637689c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:21.543889 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-3b0dc6af-b137-4c3f-99a1-173dd637689c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.427798 Jul 25 05:59:21.544456 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 57/111] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:21 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:21.604704 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4a469a2c-05c0-4e92-a48c-6a3f46e410a9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:21.612082 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-4a469a2c-05c0-4e92-a48c-6a3f46e410a9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.175388 Jul 25 05:59:21.612648 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 55/112] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:21 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:21.807837 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f8358741-0e3e-41a9-9694-9ea617521381 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:21.808397 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f8358741-0e3e-41a9-9694-9ea617521381 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:21.814838 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f8358741-0e3e-41a9-9694-9ea617521381 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:21.815281 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f8358741-0e3e-41a9-9694-9ea617521381 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:21.816055 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f8358741-0e3e-41a9-9694-9ea617521381 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:21.816487 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f8358741-0e3e-41a9-9694-9ea617521381 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:21.946230 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f8358741-0e3e-41a9-9694-9ea617521381 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:21.953890 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f8358741-0e3e-41a9-9694-9ea617521381 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.150064 Jul 25 05:59:21.954464 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 58/113] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:21 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:22.122247 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0847c246-0bb4-45f9-8aec-2d4c1983aa41 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:22.123583 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0847c246-0bb4-45f9-8aec-2d4c1983aa41 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:22.130366 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0847c246-0bb4-45f9-8aec-2d4c1983aa41 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:22.131073 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0847c246-0bb4-45f9-8aec-2d4c1983aa41 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:22.131849 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0847c246-0bb4-45f9-8aec-2d4c1983aa41 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:22.132576 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0847c246-0bb4-45f9-8aec-2d4c1983aa41 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:22.295772 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0847c246-0bb4-45f9-8aec-2d4c1983aa41 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:22.304061 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0847c246-0bb4-45f9-8aec-2d4c1983aa41 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1364 microversion: 2.1 time: 0.185584 Jul 25 05:59:22.304517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 56/114] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:22 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:22.345396 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6300372d-6ee0-483b-a31f-cf2680649c63 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:22.346017 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6300372d-6ee0-483b-a31f-cf2680649c63 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:22.352353 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6300372d-6ee0-483b-a31f-cf2680649c63 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:22.352795 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6300372d-6ee0-483b-a31f-cf2680649c63 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:22.353560 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6300372d-6ee0-483b-a31f-cf2680649c63 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:22.353996 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6300372d-6ee0-483b-a31f-cf2680649c63 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:22.489108 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6300372d-6ee0-483b-a31f-cf2680649c63 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:22.496604 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6300372d-6ee0-483b-a31f-cf2680649c63 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.155535 Jul 25 05:59:22.497171 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 59/115] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:22 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:22.565491 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0f7a5621-43c5-40b4-8d7e-7b91b74624cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:22.566120 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0f7a5621-43c5-40b4-8d7e-7b91b74624cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:22.574572 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0f7a5621-43c5-40b4-8d7e-7b91b74624cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:22.575251 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0f7a5621-43c5-40b4-8d7e-7b91b74624cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:22.576116 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0f7a5621-43c5-40b4-8d7e-7b91b74624cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:22.576785 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0f7a5621-43c5-40b4-8d7e-7b91b74624cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:22.629224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-bbfd957e-dc2a-4edb-a674-d5d1954e3009 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:22.629224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-bbfd957e-dc2a-4edb-a674-d5d1954e3009 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:22.638653 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bbfd957e-dc2a-4edb-a674-d5d1954e3009 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:22.639612 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bbfd957e-dc2a-4edb-a674-d5d1954e3009 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:22.646408 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bbfd957e-dc2a-4edb-a674-d5d1954e3009 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:22.646907 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bbfd957e-dc2a-4edb-a674-d5d1954e3009 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:22.799656 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0f7a5621-43c5-40b4-8d7e-7b91b74624cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:22.810379 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0f7a5621-43c5-40b4-8d7e-7b91b74624cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:22.815477 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0f7a5621-43c5-40b4-8d7e-7b91b74624cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:22.817408 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0f7a5621-43c5-40b4-8d7e-7b91b74624cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.259560 Jul 25 05:59:22.818590 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 57/116] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:22 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:22.847096 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-bbfd957e-dc2a-4edb-a674-d5d1954e3009 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:22.854844 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-bbfd957e-dc2a-4edb-a674-d5d1954e3009 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.230481 Jul 25 05:59:22.855404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 60/117] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:22 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:22.971678 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-153633b7-4912-4ce5-b228-fcbe0cd78f8f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:22.972481 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-153633b7-4912-4ce5-b228-fcbe0cd78f8f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:22.978939 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-153633b7-4912-4ce5-b228-fcbe0cd78f8f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:22.979580 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-153633b7-4912-4ce5-b228-fcbe0cd78f8f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:22.980421 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-153633b7-4912-4ce5-b228-fcbe0cd78f8f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:22.980830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-153633b7-4912-4ce5-b228-fcbe0cd78f8f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:23.116650 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-153633b7-4912-4ce5-b228-fcbe0cd78f8f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:23.126820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-153633b7-4912-4ce5-b228-fcbe0cd78f8f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.160473 Jul 25 05:59:23.137485 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 58/118] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:22 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:23.320216 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4bb2e528-1967-4386-b986-e9d4ecce5e70 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:23.320849 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4bb2e528-1967-4386-b986-e9d4ecce5e70 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:23.328189 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4bb2e528-1967-4386-b986-e9d4ecce5e70 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:23.329533 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4bb2e528-1967-4386-b986-e9d4ecce5e70 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:23.330413 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4bb2e528-1967-4386-b986-e9d4ecce5e70 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:23.330889 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4bb2e528-1967-4386-b986-e9d4ecce5e70 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:23.383250 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-f4656a45-2fa7-45b7-ac35-00238f789d4b req-7ae2a412-0eae-4d3b-b380-640c31165967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b706acf-4c08-4ea0-8086-3091278ad437", "tag": "1e1fdc90-5262-49b6-b5ce-47ed89f39541"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:23.387988 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=2 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:23.393751 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-f4656a45-2fa7-45b7-ac35-00238f789d4b req-7ae2a412-0eae-4d3b-b380-640c31165967 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:23.394316 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-f4656a45-2fa7-45b7-ac35-00238f789d4b req-7ae2a412-0eae-4d3b-b380-640c31165967 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:23.426943 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-f4656a45-2fa7-45b7-ac35-00238f789d4b req-7ae2a412-0eae-4d3b-b380-640c31165967 service nova] Creating event network-changed:1e1fdc90-5262-49b6-b5ce-47ed89f39541 for instance 0b706acf-4c08-4ea0-8086-3091278ad437 on hv-cinder-85083 Jul 25 05:59:23.432952 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-f4656a45-2fa7-45b7-ac35-00238f789d4b req-7ae2a412-0eae-4d3b-b380-640c31165967 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053457 Jul 25 05:59:23.434230 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 59/119] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 05:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:59:23.490855 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4bb2e528-1967-4386-b986-e9d4ecce5e70 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:23.498271 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4bb2e528-1967-4386-b986-e9d4ecce5e70 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1364 microversion: 2.1 time: 0.181938 Jul 25 05:59:23.498878 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 61/120] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:23 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:23.513619 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a368dfc9-b7af-4b12-b139-58177e1bd5a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:23.514340 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a368dfc9-b7af-4b12-b139-58177e1bd5a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:23.520632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a368dfc9-b7af-4b12-b139-58177e1bd5a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:23.521077 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a368dfc9-b7af-4b12-b139-58177e1bd5a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:23.522117 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a368dfc9-b7af-4b12-b139-58177e1bd5a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:23.522593 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a368dfc9-b7af-4b12-b139-58177e1bd5a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:23.652717 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-a368dfc9-b7af-4b12-b139-58177e1bd5a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:23.660272 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a368dfc9-b7af-4b12-b139-58177e1bd5a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.150957 Jul 25 05:59:23.660834 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 60/121] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:23 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:23.836288 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-371290c1-3cf8-4d4d-a1fd-ce57f1910595 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:23.836932 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-371290c1-3cf8-4d4d-a1fd-ce57f1910595 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:23.843754 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-371290c1-3cf8-4d4d-a1fd-ce57f1910595 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:23.844205 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-371290c1-3cf8-4d4d-a1fd-ce57f1910595 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:23.845114 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-371290c1-3cf8-4d4d-a1fd-ce57f1910595 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:23.845703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-371290c1-3cf8-4d4d-a1fd-ce57f1910595 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:23.873334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-eb55d911-f6a0-49a4-b900-12d7679d8410 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:23.875263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-eb55d911-f6a0-49a4-b900-12d7679d8410 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:23.907932 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eb55d911-f6a0-49a4-b900-12d7679d8410 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:23.910986 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eb55d911-f6a0-49a4-b900-12d7679d8410 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:23.915630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eb55d911-f6a0-49a4-b900-12d7679d8410 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:23.916841 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eb55d911-f6a0-49a4-b900-12d7679d8410 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:24.040996 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-371290c1-3cf8-4d4d-a1fd-ce57f1910595 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:24.050799 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-371290c1-3cf8-4d4d-a1fd-ce57f1910595 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:24.052440 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-371290c1-3cf8-4d4d-a1fd-ce57f1910595 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:24.053635 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-371290c1-3cf8-4d4d-a1fd-ce57f1910595 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.221331 Jul 25 05:59:24.054280 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 62/122] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:23 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:24.143453 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4e4c3627-8a14-490d-9552-835a54e44468 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:24.144255 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4e4c3627-8a14-490d-9552-835a54e44468 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:24.153776 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4e4c3627-8a14-490d-9552-835a54e44468 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:24.157206 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4e4c3627-8a14-490d-9552-835a54e44468 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:24.157206 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4e4c3627-8a14-490d-9552-835a54e44468 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:24.157206 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4e4c3627-8a14-490d-9552-835a54e44468 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:24.159698 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=100 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:24.334797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4e4c3627-8a14-490d-9552-835a54e44468 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:24.345281 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4e4c3627-8a14-490d-9552-835a54e44468 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.205446 Jul 25 05:59:24.354902 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 63/123] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:24 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:24.524752 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7d279eb4-932f-422b-aad2-674011b1a5b5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:24.526846 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7d279eb4-932f-422b-aad2-674011b1a5b5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:24.551658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7d279eb4-932f-422b-aad2-674011b1a5b5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:24.551658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7d279eb4-932f-422b-aad2-674011b1a5b5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:24.551658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7d279eb4-932f-422b-aad2-674011b1a5b5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:24.551658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7d279eb4-932f-422b-aad2-674011b1a5b5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:24.605121 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-eb55d911-f6a0-49a4-b900-12d7679d8410 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:24.622645 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-eb55d911-f6a0-49a4-b900-12d7679d8410 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.754175 Jul 25 05:59:24.624810 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 61/124] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:23 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:24.678412 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b33304af-a791-4622-a5a3-df68e7cdadbd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:24.679094 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b33304af-a791-4622-a5a3-df68e7cdadbd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:24.691752 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b33304af-a791-4622-a5a3-df68e7cdadbd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:24.692208 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b33304af-a791-4622-a5a3-df68e7cdadbd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:24.693632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b33304af-a791-4622-a5a3-df68e7cdadbd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:24.694114 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b33304af-a791-4622-a5a3-df68e7cdadbd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:24.784715 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7d279eb4-932f-422b-aad2-674011b1a5b5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:24.798213 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-7d279eb4-932f-422b-aad2-674011b1a5b5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1364 microversion: 2.1 time: 0.280780 Jul 25 05:59:24.801390 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 64/125] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:24 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1364 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:25.075701 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f592ffbf-646f-42e3-9701-6f958c8cdc98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:25.076390 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f592ffbf-646f-42e3-9701-6f958c8cdc98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:25.091881 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f592ffbf-646f-42e3-9701-6f958c8cdc98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:25.092491 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f592ffbf-646f-42e3-9701-6f958c8cdc98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:25.094351 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f592ffbf-646f-42e3-9701-6f958c8cdc98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:25.095328 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f592ffbf-646f-42e3-9701-6f958c8cdc98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:25.219755 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b33304af-a791-4622-a5a3-df68e7cdadbd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:25.228247 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b33304af-a791-4622-a5a3-df68e7cdadbd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.554139 Jul 25 05:59:25.229016 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 62/126] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:24 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:25.269242 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f592ffbf-646f-42e3-9701-6f958c8cdc98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:25.277388 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f592ffbf-646f-42e3-9701-6f958c8cdc98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:25.279025 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f592ffbf-646f-42e3-9701-6f958c8cdc98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:25.280246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f592ffbf-646f-42e3-9701-6f958c8cdc98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.208969 Jul 25 05:59:25.280823 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 65/127] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:25 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:59:25.362760 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a7a81e40-142d-477f-9c79-c24215bf1713 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:25.363383 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a7a81e40-142d-477f-9c79-c24215bf1713 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:25.369318 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a7a81e40-142d-477f-9c79-c24215bf1713 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:25.372549 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a7a81e40-142d-477f-9c79-c24215bf1713 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:25.372549 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a7a81e40-142d-477f-9c79-c24215bf1713 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:25.372549 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a7a81e40-142d-477f-9c79-c24215bf1713 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:25.502974 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-a7a81e40-142d-477f-9c79-c24215bf1713 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:25.510302 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a7a81e40-142d-477f-9c79-c24215bf1713 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.151612 Jul 25 05:59:25.510921 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 63/128] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:25 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:25.639527 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-85637c85-243d-4df1-aef4-847d59048a18 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:25.640137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-85637c85-243d-4df1-aef4-847d59048a18 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:25.646066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-85637c85-243d-4df1-aef4-847d59048a18 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:25.646536 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-85637c85-243d-4df1-aef4-847d59048a18 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:25.647294 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-85637c85-243d-4df1-aef4-847d59048a18 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:25.647731 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-85637c85-243d-4df1-aef4-847d59048a18 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:25.781446 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-85637c85-243d-4df1-aef4-847d59048a18 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:25.790399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-85637c85-243d-4df1-aef4-847d59048a18 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.154453 Jul 25 05:59:25.798619 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 66/129] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:25 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:25.817002 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cd5fcaa5-5ec4-4b9d-a5a3-82382673f002 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:25.817720 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-cd5fcaa5-5ec4-4b9d-a5a3-82382673f002 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:25.823946 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd5fcaa5-5ec4-4b9d-a5a3-82382673f002 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:25.824387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd5fcaa5-5ec4-4b9d-a5a3-82382673f002 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:25.825151 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd5fcaa5-5ec4-4b9d-a5a3-82382673f002 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:25.825581 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd5fcaa5-5ec4-4b9d-a5a3-82382673f002 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:26.245960 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-1fc9251b-b1b1-4002-8527-e263155c6940 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:26.247221 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-1fc9251b-b1b1-4002-8527-e263155c6940 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:26.261295 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1fc9251b-b1b1-4002-8527-e263155c6940 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:26.262449 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1fc9251b-b1b1-4002-8527-e263155c6940 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:26.263506 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1fc9251b-b1b1-4002-8527-e263155c6940 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:26.264108 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1fc9251b-b1b1-4002-8527-e263155c6940 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:26.433846 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cd5fcaa5-5ec4-4b9d-a5a3-82382673f002 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:26.446915 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-cd5fcaa5-5ec4-4b9d-a5a3-82382673f002 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1364 microversion: 2.1 time: 0.634520 Jul 25 05:59:26.447505 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 64/130] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:25 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1364 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:26.452105 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-58d3a367-5664-4d58-8e18-6044fa4bb9c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:26.453438 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-58d3a367-5664-4d58-8e18-6044fa4bb9c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:26.468365 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-58d3a367-5664-4d58-8e18-6044fa4bb9c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:26.469547 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-58d3a367-5664-4d58-8e18-6044fa4bb9c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:26.470493 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-58d3a367-5664-4d58-8e18-6044fa4bb9c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:26.471079 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-58d3a367-5664-4d58-8e18-6044fa4bb9c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:26.473614 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-1fc9251b-b1b1-4002-8527-e263155c6940 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:26.499752 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-1fc9251b-b1b1-4002-8527-e263155c6940 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.257728 Jul 25 05:59:26.501015 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 67/131] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:26 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:26.528662 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-87dfd750-5d6b-436b-84f8-b952b60a809f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:26.532229 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-87dfd750-5d6b-436b-84f8-b952b60a809f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:26.540307 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-87dfd750-5d6b-436b-84f8-b952b60a809f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:26.541049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-87dfd750-5d6b-436b-84f8-b952b60a809f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:26.541831 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-87dfd750-5d6b-436b-84f8-b952b60a809f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:26.542261 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-87dfd750-5d6b-436b-84f8-b952b60a809f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:26.715304 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-87dfd750-5d6b-436b-84f8-b952b60a809f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:26.724682 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-87dfd750-5d6b-436b-84f8-b952b60a809f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.200507 Jul 25 05:59:26.725617 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-58d3a367-5664-4d58-8e18-6044fa4bb9c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:26.726335 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 68/132] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:26 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:26.733634 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-58d3a367-5664-4d58-8e18-6044fa4bb9c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:26.735768 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-58d3a367-5664-4d58-8e18-6044fa4bb9c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:26.736898 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-58d3a367-5664-4d58-8e18-6044fa4bb9c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.288324 Jul 25 05:59:26.737527 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 65/133] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:26 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:26.807884 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-273b2289-f3eb-4030-99aa-21e01f3ad2da tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:26.808497 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-273b2289-f3eb-4030-99aa-21e01f3ad2da tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:26.818191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-273b2289-f3eb-4030-99aa-21e01f3ad2da tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:26.822696 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-273b2289-f3eb-4030-99aa-21e01f3ad2da tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:26.823761 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-273b2289-f3eb-4030-99aa-21e01f3ad2da tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:26.824237 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-273b2289-f3eb-4030-99aa-21e01f3ad2da tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:26.826074 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-7ced5ddc-4c78-402e-9cef-5c84ee55506c req-749b0b85-effb-4f57-82bf-362775efdcda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0848c502-1383-407a-94d1-b92892dff9e4", "name": "network-vif-plugged", "status": "completed", "tag": "d095699d-c625-4730-8749-c485d48d194f"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:26.836899 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-7ced5ddc-4c78-402e-9cef-5c84ee55506c req-749b0b85-effb-4f57-82bf-362775efdcda service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:26.837672 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-7ced5ddc-4c78-402e-9cef-5c84ee55506c req-749b0b85-effb-4f57-82bf-362775efdcda service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:26.854441 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-7ced5ddc-4c78-402e-9cef-5c84ee55506c req-749b0b85-effb-4f57-82bf-362775efdcda service nova] Creating event network-vif-plugged:d095699d-c625-4730-8749-c485d48d194f for instance 0848c502-1383-407a-94d1-b92892dff9e4 on hv-cinder-85083 Jul 25 05:59:26.865938 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-7ced5ddc-4c78-402e-9cef-5c84ee55506c req-749b0b85-effb-4f57-82bf-362775efdcda service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112553 Jul 25 05:59:26.867352 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 69/134] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 05:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:26.974941 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-273b2289-f3eb-4030-99aa-21e01f3ad2da tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:26.982434 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-273b2289-f3eb-4030-99aa-21e01f3ad2da tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.178513 Jul 25 05:59:26.983063 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 66/135] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:26 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:27.464544 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-35d2673c-bb96-4327-bbed-2bb3d1ffa0fc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:27.465247 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-35d2673c-bb96-4327-bbed-2bb3d1ffa0fc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:27.474800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-35d2673c-bb96-4327-bbed-2bb3d1ffa0fc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:27.475467 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-35d2673c-bb96-4327-bbed-2bb3d1ffa0fc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:27.476459 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-35d2673c-bb96-4327-bbed-2bb3d1ffa0fc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:27.476891 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-35d2673c-bb96-4327-bbed-2bb3d1ffa0fc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:27.518279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0b43d5f1-0520-4bf8-a725-39585c8c0d1b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:27.519275 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0b43d5f1-0520-4bf8-a725-39585c8c0d1b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:27.528641 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0b43d5f1-0520-4bf8-a725-39585c8c0d1b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:27.528641 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0b43d5f1-0520-4bf8-a725-39585c8c0d1b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:27.528641 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0b43d5f1-0520-4bf8-a725-39585c8c0d1b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:27.528641 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0b43d5f1-0520-4bf8-a725-39585c8c0d1b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:27.637008 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-35d2673c-bb96-4327-bbed-2bb3d1ffa0fc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:27.644993 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-35d2673c-bb96-4327-bbed-2bb3d1ffa0fc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1364 microversion: 2.1 time: 0.184789 Jul 25 05:59:27.645572 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 70/136] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:27 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:27.725724 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0b43d5f1-0520-4bf8-a725-39585c8c0d1b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:27.733731 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0b43d5f1-0520-4bf8-a725-39585c8c0d1b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.220507 Jul 25 05:59:27.734302 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 67/137] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:27 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:27.743226 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b5282f1f-406a-4fcf-85f3-daf30b294767 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:27.743924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b5282f1f-406a-4fcf-85f3-daf30b294767 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:27.750565 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b5282f1f-406a-4fcf-85f3-daf30b294767 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:27.751091 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b5282f1f-406a-4fcf-85f3-daf30b294767 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:27.751926 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b5282f1f-406a-4fcf-85f3-daf30b294767 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:27.752455 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b5282f1f-406a-4fcf-85f3-daf30b294767 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:27.755439 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-386d6aa3-c730-4ca2-9076-3ea25c4ef1cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:27.757655 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-386d6aa3-c730-4ca2-9076-3ea25c4ef1cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:27.762005 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-386d6aa3-c730-4ca2-9076-3ea25c4ef1cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:27.762457 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-386d6aa3-c730-4ca2-9076-3ea25c4ef1cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:27.763279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-386d6aa3-c730-4ca2-9076-3ea25c4ef1cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:27.763712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-386d6aa3-c730-4ca2-9076-3ea25c4ef1cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:27.889720 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b5282f1f-406a-4fcf-85f3-daf30b294767 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:27.912011 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-386d6aa3-c730-4ca2-9076-3ea25c4ef1cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:27.914848 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b5282f1f-406a-4fcf-85f3-daf30b294767 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.175377 Jul 25 05:59:27.915437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 71/138] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:27 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:27.928583 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-386d6aa3-c730-4ca2-9076-3ea25c4ef1cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:27.928583 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-386d6aa3-c730-4ca2-9076-3ea25c4ef1cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:27.928583 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-386d6aa3-c730-4ca2-9076-3ea25c4ef1cd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.175086 Jul 25 05:59:27.929226 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 68/139] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:27 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:59:27.998945 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-dff7143e-2994-4cb1-9a0b-bfd6cd1e92a4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:27.999582 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-dff7143e-2994-4cb1-9a0b-bfd6cd1e92a4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:28.008971 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dff7143e-2994-4cb1-9a0b-bfd6cd1e92a4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:28.009606 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dff7143e-2994-4cb1-9a0b-bfd6cd1e92a4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:28.010324 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dff7143e-2994-4cb1-9a0b-bfd6cd1e92a4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:28.010789 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dff7143e-2994-4cb1-9a0b-bfd6cd1e92a4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:28.156596 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-dff7143e-2994-4cb1-9a0b-bfd6cd1e92a4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:28.164247 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-dff7143e-2994-4cb1-9a0b-bfd6cd1e92a4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.169399 Jul 25 05:59:28.164805 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 72/140] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:27 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:28.663892 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cd7ce0a2-3646-4597-8a9a-1a09acde6adb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:28.664717 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-cd7ce0a2-3646-4597-8a9a-1a09acde6adb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:28.671574 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd7ce0a2-3646-4597-8a9a-1a09acde6adb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:28.672359 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd7ce0a2-3646-4597-8a9a-1a09acde6adb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:28.673460 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd7ce0a2-3646-4597-8a9a-1a09acde6adb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:28.674196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd7ce0a2-3646-4597-8a9a-1a09acde6adb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:28.750658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-63135d9a-e068-41b2-a4ca-a8f52eb21cf6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:28.751204 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-63135d9a-e068-41b2-a4ca-a8f52eb21cf6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:28.772043 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63135d9a-e068-41b2-a4ca-a8f52eb21cf6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:28.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63135d9a-e068-41b2-a4ca-a8f52eb21cf6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:28.773290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63135d9a-e068-41b2-a4ca-a8f52eb21cf6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:28.773729 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63135d9a-e068-41b2-a4ca-a8f52eb21cf6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:28.855245 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cd7ce0a2-3646-4597-8a9a-1a09acde6adb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:28.872218 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-cd7ce0a2-3646-4597-8a9a-1a09acde6adb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1364 microversion: 2.1 time: 0.214322 Jul 25 05:59:28.885823 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 69/141] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:28 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:28.896734 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-bd236684-2255-4cdf-819d-f656462ce66d req-abe7f79f-157e-446c-8e73-cd28fe7c07f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af46a4c-7081-4329-bcb1-df497104456e", "name": "network-vif-plugged", "status": "completed", "tag": "84dfe514-aa89-4462-b8cb-4f42811b6545"}, {"server_uuid": "57462ad3-d5fc-4dee-9087-afc18c4f0305", "name": "network-vif-plugged", "status": "completed", "tag": "01a10501-1421-4069-8834-45e48a9bab40"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:28.914376 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-bd236684-2255-4cdf-819d-f656462ce66d req-abe7f79f-157e-446c-8e73-cd28fe7c07f2 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:28.915437 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-bd236684-2255-4cdf-819d-f656462ce66d req-abe7f79f-157e-446c-8e73-cd28fe7c07f2 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:28.933693 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-bd236684-2255-4cdf-819d-f656462ce66d req-abe7f79f-157e-446c-8e73-cd28fe7c07f2 service nova] Creating event network-vif-plugged:84dfe514-aa89-4462-b8cb-4f42811b6545 for instance 6af46a4c-7081-4329-bcb1-df497104456e on hv-cinder-85083 Jul 25 05:59:28.934721 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-bd236684-2255-4cdf-819d-f656462ce66d req-abe7f79f-157e-446c-8e73-cd28fe7c07f2 service nova] Creating event network-vif-plugged:01a10501-1421-4069-8834-45e48a9bab40 for instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 on hv-cinder-85083 Jul 25 05:59:28.944226 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-bd236684-2255-4cdf-819d-f656462ce66d req-abe7f79f-157e-446c-8e73-cd28fe7c07f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056198 Jul 25 05:59:28.945521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 70/142] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 05:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:28.950668 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-4082d7e1-1d08-4458-a5ea-4b500338e1e1 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:28.951739 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-4082d7e1-1d08-4458-a5ea-4b500338e1e1 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:28.959014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4082d7e1-1d08-4458-a5ea-4b500338e1e1 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:28.959468 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4082d7e1-1d08-4458-a5ea-4b500338e1e1 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:28.961651 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4082d7e1-1d08-4458-a5ea-4b500338e1e1 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:28.962167 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4082d7e1-1d08-4458-a5ea-4b500338e1e1 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:29.001329 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-63135d9a-e068-41b2-a4ca-a8f52eb21cf6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:29.009125 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-63135d9a-e068-41b2-a4ca-a8f52eb21cf6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.262628 Jul 25 05:59:29.015199 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 73/143] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:28 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:29.026880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-394a0bfb-8b5d-4fa6-aced-84d36c78ef8f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:29.027496 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-394a0bfb-8b5d-4fa6-aced-84d36c78ef8f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:29.036250 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-394a0bfb-8b5d-4fa6-aced-84d36c78ef8f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:29.036970 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-394a0bfb-8b5d-4fa6-aced-84d36c78ef8f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:29.038034 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-394a0bfb-8b5d-4fa6-aced-84d36c78ef8f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:29.038660 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-394a0bfb-8b5d-4fa6-aced-84d36c78ef8f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:29.108793 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4082d7e1-1d08-4458-a5ea-4b500338e1e1 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:29.116832 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-4082d7e1-1d08-4458-a5ea-4b500338e1e1 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.170320 Jul 25 05:59:29.117891 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 71/144] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:28 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:29.182445 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-85078af2-a3a2-4dfe-a4eb-27adb9d47f1a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:29.183281 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-85078af2-a3a2-4dfe-a4eb-27adb9d47f1a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:29.193061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-394a0bfb-8b5d-4fa6-aced-84d36c78ef8f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:29.199403 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-85078af2-a3a2-4dfe-a4eb-27adb9d47f1a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:29.200049 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-85078af2-a3a2-4dfe-a4eb-27adb9d47f1a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:29.201237 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-85078af2-a3a2-4dfe-a4eb-27adb9d47f1a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:29.201381 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-394a0bfb-8b5d-4fa6-aced-84d36c78ef8f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:29.202208 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-85078af2-a3a2-4dfe-a4eb-27adb9d47f1a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:29.203579 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-394a0bfb-8b5d-4fa6-aced-84d36c78ef8f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:29.204692 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-394a0bfb-8b5d-4fa6-aced-84d36c78ef8f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.187528 Jul 25 05:59:29.205656 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 74/145] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:29 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:29.339356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-85078af2-a3a2-4dfe-a4eb-27adb9d47f1a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:29.342985 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=100 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:29.348646 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-85078af2-a3a2-4dfe-a4eb-27adb9d47f1a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.170949 Jul 25 05:59:29.357781 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 72/146] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:29 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:29.889788 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5f57270b-2f3f-41a9-bcb4-e99059a9f252 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:29.892362 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5f57270b-2f3f-41a9-bcb4-e99059a9f252 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:29.897254 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5f57270b-2f3f-41a9-bcb4-e99059a9f252 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:29.897911 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5f57270b-2f3f-41a9-bcb4-e99059a9f252 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:29.898876 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5f57270b-2f3f-41a9-bcb4-e99059a9f252 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:29.899471 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5f57270b-2f3f-41a9-bcb4-e99059a9f252 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:30.031718 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-662912e9-6c3e-42b7-845d-96dffa4676a4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:30.032318 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-662912e9-6c3e-42b7-845d-96dffa4676a4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:30.039773 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-662912e9-6c3e-42b7-845d-96dffa4676a4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:30.040223 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-662912e9-6c3e-42b7-845d-96dffa4676a4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:30.040985 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-662912e9-6c3e-42b7-845d-96dffa4676a4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:30.041420 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-662912e9-6c3e-42b7-845d-96dffa4676a4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:30.077495 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5f57270b-2f3f-41a9-bcb4-e99059a9f252 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:30.084904 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5f57270b-2f3f-41a9-bcb4-e99059a9f252 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1364 microversion: 2.1 time: 0.199232 Jul 25 05:59:30.090736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 75/147] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:29 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:30.134531 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-75e8739a-ab44-47ff-8821-2977b8ee7d43 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:30.135392 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-75e8739a-ab44-47ff-8821-2977b8ee7d43 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:30.141886 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-75e8739a-ab44-47ff-8821-2977b8ee7d43 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:30.142333 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-75e8739a-ab44-47ff-8821-2977b8ee7d43 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:30.143124 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-75e8739a-ab44-47ff-8821-2977b8ee7d43 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:30.143555 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-75e8739a-ab44-47ff-8821-2977b8ee7d43 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:30.250327 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-662912e9-6c3e-42b7-845d-96dffa4676a4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:30.259849 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-662912e9-6c3e-42b7-845d-96dffa4676a4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.232460 Jul 25 05:59:30.260966 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 73/148] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:30 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:30.266615 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b0970d1a-61af-48ed-95c6-3e1ec007ebd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:30.267388 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b0970d1a-61af-48ed-95c6-3e1ec007ebd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:30.273390 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b0970d1a-61af-48ed-95c6-3e1ec007ebd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:30.274016 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b0970d1a-61af-48ed-95c6-3e1ec007ebd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:30.275097 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b0970d1a-61af-48ed-95c6-3e1ec007ebd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:30.275610 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b0970d1a-61af-48ed-95c6-3e1ec007ebd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:30.299274 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-75e8739a-ab44-47ff-8821-2977b8ee7d43 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:30.315797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-75e8739a-ab44-47ff-8821-2977b8ee7d43 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.181686 Jul 25 05:59:30.316512 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 76/149] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:30 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:30.365465 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-0b1a0ee4-c9ae-40c2-acb6-e744f312dc26 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:30.366433 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-0b1a0ee4-c9ae-40c2-acb6-e744f312dc26 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:30.375436 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0b1a0ee4-c9ae-40c2-acb6-e744f312dc26 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:30.385947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0b1a0ee4-c9ae-40c2-acb6-e744f312dc26 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:30.388219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0b1a0ee4-c9ae-40c2-acb6-e744f312dc26 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:30.388680 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0b1a0ee4-c9ae-40c2-acb6-e744f312dc26 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:30.433261 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b0970d1a-61af-48ed-95c6-3e1ec007ebd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:30.437472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b0970d1a-61af-48ed-95c6-3e1ec007ebd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:30.439102 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b0970d1a-61af-48ed-95c6-3e1ec007ebd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:30.441660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b0970d1a-61af-48ed-95c6-3e1ec007ebd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.179515 Jul 25 05:59:30.442232 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 74/150] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:30 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:30.624247 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-0b1a0ee4-c9ae-40c2-acb6-e744f312dc26 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:30.632298 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-0b1a0ee4-c9ae-40c2-acb6-e744f312dc26 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.270912 Jul 25 05:59:30.633351 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 77/151] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:30 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:31.104088 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9f20bddd-dc53-4bcb-a79c-8ade9fc5a207 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:31.105439 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-9f20bddd-dc53-4bcb-a79c-8ade9fc5a207 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:31.118590 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9f20bddd-dc53-4bcb-a79c-8ade9fc5a207 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:31.120437 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9f20bddd-dc53-4bcb-a79c-8ade9fc5a207 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:31.123830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9f20bddd-dc53-4bcb-a79c-8ade9fc5a207 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:31.125578 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9f20bddd-dc53-4bcb-a79c-8ade9fc5a207 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:31.282457 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-69ee9efb-05d1-48fb-a128-33007eaad0e1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:31.283771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-69ee9efb-05d1-48fb-a128-33007eaad0e1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:31.293318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-69ee9efb-05d1-48fb-a128-33007eaad0e1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:31.293899 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-69ee9efb-05d1-48fb-a128-33007eaad0e1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:31.294868 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-69ee9efb-05d1-48fb-a128-33007eaad0e1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:31.295389 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-69ee9efb-05d1-48fb-a128-33007eaad0e1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:31.451409 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-9f20bddd-dc53-4bcb-a79c-8ade9fc5a207 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:31.453972 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-69ee9efb-05d1-48fb-a128-33007eaad0e1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:31.458946 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-9f20bddd-dc53-4bcb-a79c-8ade9fc5a207 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1364 microversion: 2.1 time: 0.359761 Jul 25 05:59:31.459518 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 75/152] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:31 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1364 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:31.463284 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-69ee9efb-05d1-48fb-a128-33007eaad0e1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.189521 Jul 25 05:59:31.466105 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 78/153] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:31 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:31.471925 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-87f811d8-21e6-4268-ae32-d56e402eeb09 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:31.474309 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-87f811d8-21e6-4268-ae32-d56e402eeb09 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:31.474887 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-971b4018-10ac-455b-b690-cb455e427db2 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:31.477549 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-971b4018-10ac-455b-b690-cb455e427db2 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:31.483303 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-87f811d8-21e6-4268-ae32-d56e402eeb09 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:31.484522 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-87f811d8-21e6-4268-ae32-d56e402eeb09 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:31.485447 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-87f811d8-21e6-4268-ae32-d56e402eeb09 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:31.486149 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-87f811d8-21e6-4268-ae32-d56e402eeb09 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:31.489511 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:31.495777 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-971b4018-10ac-455b-b690-cb455e427db2 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:31.500132 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-971b4018-10ac-455b-b690-cb455e427db2 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:31.503672 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-971b4018-10ac-455b-b690-cb455e427db2 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:31.504229 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-971b4018-10ac-455b-b690-cb455e427db2 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:31.688599 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-87f811d8-21e6-4268-ae32-d56e402eeb09 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:31.693122 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-971b4018-10ac-455b-b690-cb455e427db2 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:31.701338 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-971b4018-10ac-455b-b690-cb455e427db2 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.233967 Jul 25 05:59:31.701944 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 79/154] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:31 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:31.709738 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4eb166e7-f081-436a-831a-499a8c6ca4d1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:31.710563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4eb166e7-f081-436a-831a-499a8c6ca4d1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:31.710853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-87f811d8-21e6-4268-ae32-d56e402eeb09 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:31.712799 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-87f811d8-21e6-4268-ae32-d56e402eeb09 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:31.713945 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-87f811d8-21e6-4268-ae32-d56e402eeb09 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.246290 Jul 25 05:59:31.714548 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 76/155] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:31 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:31.717632 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4eb166e7-f081-436a-831a-499a8c6ca4d1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:31.718301 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4eb166e7-f081-436a-831a-499a8c6ca4d1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:31.719764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4eb166e7-f081-436a-831a-499a8c6ca4d1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:31.720194 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4eb166e7-f081-436a-831a-499a8c6ca4d1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:31.739286 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=100 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:31.854852 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4eb166e7-f081-436a-831a-499a8c6ca4d1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:31.862748 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4eb166e7-f081-436a-831a-499a8c6ca4d1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.159833 Jul 25 05:59:31.868118 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 80/156] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:31 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:32.411014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-ff277e23-1016-48e8-97bc-4e98d3f12d53 req-e3746c48-3c35-4d2f-b9b0-f64f3cc46704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479a7885-4c31-448b-8d0d-42049d47896f", "name": "network-vif-plugged", "status": "completed", "tag": "70a76596-074b-4a73-b7c5-338b9b7a51d2"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:32.420374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-ff277e23-1016-48e8-97bc-4e98d3f12d53 req-e3746c48-3c35-4d2f-b9b0-f64f3cc46704 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:32.422507 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-ff277e23-1016-48e8-97bc-4e98d3f12d53 req-e3746c48-3c35-4d2f-b9b0-f64f3cc46704 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:32.436938 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-ff277e23-1016-48e8-97bc-4e98d3f12d53 req-e3746c48-3c35-4d2f-b9b0-f64f3cc46704 service nova] Creating event network-vif-plugged:70a76596-074b-4a73-b7c5-338b9b7a51d2 for instance 479a7885-4c31-448b-8d0d-42049d47896f on hv-cinder-85083 Jul 25 05:59:32.443501 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-ff277e23-1016-48e8-97bc-4e98d3f12d53 req-e3746c48-3c35-4d2f-b9b0-f64f3cc46704 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036891 Jul 25 05:59:32.444305 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 77/157] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 05:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:32.485795 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-df9e60ad-fc20-40d8-85b1-20b3860fd232 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:32.486515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-df9e60ad-fc20-40d8-85b1-20b3860fd232 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:32.487532 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-7a5cb6f1-0e44-44e7-af91-38d1e042cca3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:32.488435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-7a5cb6f1-0e44-44e7-af91-38d1e042cca3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:32.498794 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-df9e60ad-fc20-40d8-85b1-20b3860fd232 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:32.500948 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-df9e60ad-fc20-40d8-85b1-20b3860fd232 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:32.502021 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-df9e60ad-fc20-40d8-85b1-20b3860fd232 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:32.503211 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7a5cb6f1-0e44-44e7-af91-38d1e042cca3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:32.503738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7a5cb6f1-0e44-44e7-af91-38d1e042cca3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:32.503902 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-df9e60ad-fc20-40d8-85b1-20b3860fd232 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:32.504556 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7a5cb6f1-0e44-44e7-af91-38d1e042cca3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:32.504999 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7a5cb6f1-0e44-44e7-af91-38d1e042cca3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:32.652627 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-df9e60ad-fc20-40d8-85b1-20b3860fd232 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:32.662829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-df9e60ad-fc20-40d8-85b1-20b3860fd232 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1364 microversion: 2.1 time: 0.181865 Jul 25 05:59:32.663398 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 81/158] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:32 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:32.720386 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f24fb030-666c-49b9-a6eb-f0849dc5a828 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:32.720991 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f24fb030-666c-49b9-a6eb-f0849dc5a828 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:32.730691 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f24fb030-666c-49b9-a6eb-f0849dc5a828 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:32.732296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f24fb030-666c-49b9-a6eb-f0849dc5a828 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:32.733390 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f24fb030-666c-49b9-a6eb-f0849dc5a828 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:32.734705 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-7a5cb6f1-0e44-44e7-af91-38d1e042cca3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:32.734895 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f24fb030-666c-49b9-a6eb-f0849dc5a828 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:32.748027 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-7a5cb6f1-0e44-44e7-af91-38d1e042cca3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.266494 Jul 25 05:59:32.748624 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 78/159] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:32 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:32.760562 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-430df03c-b743-440c-92be-d460f5017904 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:32.763946 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-430df03c-b743-440c-92be-d460f5017904 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:32.778465 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-430df03c-b743-440c-92be-d460f5017904 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:32.781771 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-430df03c-b743-440c-92be-d460f5017904 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:32.783155 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-430df03c-b743-440c-92be-d460f5017904 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:32.785292 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-430df03c-b743-440c-92be-d460f5017904 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:32.950460 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f24fb030-666c-49b9-a6eb-f0849dc5a828 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:32.958852 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f24fb030-666c-49b9-a6eb-f0849dc5a828 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.243350 Jul 25 05:59:32.960760 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 82/160] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:32 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:32.965913 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ad4437c3-646a-468f-9213-8b13692c954c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:32.966744 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ad4437c3-646a-468f-9213-8b13692c954c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:32.975196 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ad4437c3-646a-468f-9213-8b13692c954c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:32.975736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ad4437c3-646a-468f-9213-8b13692c954c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:32.976571 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ad4437c3-646a-468f-9213-8b13692c954c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:32.977192 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ad4437c3-646a-468f-9213-8b13692c954c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:32.998077 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-430df03c-b743-440c-92be-d460f5017904 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:33.007101 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-430df03c-b743-440c-92be-d460f5017904 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:33.008890 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-430df03c-b743-440c-92be-d460f5017904 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:33.010192 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-430df03c-b743-440c-92be-d460f5017904 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.258467 Jul 25 05:59:33.011098 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 79/161] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:32 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:33.160953 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ad4437c3-646a-468f-9213-8b13692c954c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:33.169597 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ad4437c3-646a-468f-9213-8b13692c954c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.209045 Jul 25 05:59:33.170166 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 83/162] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:32 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:33.680592 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-4a9afa0b-a6fe-4951-a95b-6428de174fb0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:33.681754 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-4a9afa0b-a6fe-4951-a95b-6428de174fb0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:33.689068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4a9afa0b-a6fe-4951-a95b-6428de174fb0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:33.689744 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4a9afa0b-a6fe-4951-a95b-6428de174fb0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:33.690938 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4a9afa0b-a6fe-4951-a95b-6428de174fb0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:33.696039 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4a9afa0b-a6fe-4951-a95b-6428de174fb0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:33.765958 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-45c90cf5-b883-4c15-b41b-4c0d60d9ef96 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:33.766587 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-45c90cf5-b883-4c15-b41b-4c0d60d9ef96 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:33.772643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-45c90cf5-b883-4c15-b41b-4c0d60d9ef96 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:33.773039 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-45c90cf5-b883-4c15-b41b-4c0d60d9ef96 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:33.773865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-45c90cf5-b883-4c15-b41b-4c0d60d9ef96 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:33.774199 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-45c90cf5-b883-4c15-b41b-4c0d60d9ef96 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:33.831973 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4a9afa0b-a6fe-4951-a95b-6428de174fb0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:33.839593 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-4a9afa0b-a6fe-4951-a95b-6428de174fb0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1364 microversion: 2.1 time: 0.162757 Jul 25 05:59:33.840175 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 80/163] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:33 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:33.929571 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-45c90cf5-b883-4c15-b41b-4c0d60d9ef96 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:33.938095 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-45c90cf5-b883-4c15-b41b-4c0d60d9ef96 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1321 microversion: 2.1 time: 0.175802 Jul 25 05:59:33.942521 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 84/164] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:33 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:33.977216 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-aaca21d4-d756-4947-80ea-301a7bd4e642 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:33.977828 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-aaca21d4-d756-4947-80ea-301a7bd4e642 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:33.983753 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aaca21d4-d756-4947-80ea-301a7bd4e642 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:33.984727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aaca21d4-d756-4947-80ea-301a7bd4e642 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:33.985484 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aaca21d4-d756-4947-80ea-301a7bd4e642 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:33.985916 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aaca21d4-d756-4947-80ea-301a7bd4e642 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:34.031468 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-27f27981-ce90-4b9a-9783-eb13df6636db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:34.032090 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-27f27981-ce90-4b9a-9783-eb13df6636db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:34.040209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-27f27981-ce90-4b9a-9783-eb13df6636db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:34.040997 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-27f27981-ce90-4b9a-9783-eb13df6636db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:34.042772 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-27f27981-ce90-4b9a-9783-eb13df6636db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:34.042772 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-27f27981-ce90-4b9a-9783-eb13df6636db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:34.205650 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-aaca21d4-d756-4947-80ea-301a7bd4e642 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:34.213464 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-aaca21d4-d756-4947-80ea-301a7bd4e642 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1315 microversion: 2.1 time: 0.239963 Jul 25 05:59:34.213991 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 81/165] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:33 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:34.236241 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-bd2ea958-30f3-4e7c-9e19-d5e9d9704378 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:34.240681 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-bd2ea958-30f3-4e7c-9e19-d5e9d9704378 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:34.245021 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-27f27981-ce90-4b9a-9783-eb13df6636db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:34.248744 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bd2ea958-30f3-4e7c-9e19-d5e9d9704378 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:34.249442 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bd2ea958-30f3-4e7c-9e19-d5e9d9704378 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:34.250586 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bd2ea958-30f3-4e7c-9e19-d5e9d9704378 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:34.251174 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bd2ea958-30f3-4e7c-9e19-d5e9d9704378 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:34.254001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-27f27981-ce90-4b9a-9783-eb13df6636db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:34.255543 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-27f27981-ce90-4b9a-9783-eb13df6636db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:34.268890 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-27f27981-ce90-4b9a-9783-eb13df6636db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.241507 Jul 25 05:59:34.270465 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 85/166] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:34 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:59:34.509355 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-bd2ea958-30f3-4e7c-9e19-d5e9d9704378 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:34.521821 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-bd2ea958-30f3-4e7c-9e19-d5e9d9704378 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.306757 Jul 25 05:59:34.522400 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 82/167] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:34 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:34.547621 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-99556b03-6e2e-44c2-92a0-e8bb411bb81f req-3c6e5271-8e51-46ab-98f4-56bc118d525a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "348f256d-41e5-47d8-b165-cad6dfcd0be9", "name": "network-vif-plugged", "status": "completed", "tag": "f9f7f9cc-3fd7-49f4-b8f2-59f247cf93e3"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:34.569280 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-99556b03-6e2e-44c2-92a0-e8bb411bb81f req-3c6e5271-8e51-46ab-98f4-56bc118d525a service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:34.571210 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-99556b03-6e2e-44c2-92a0-e8bb411bb81f req-3c6e5271-8e51-46ab-98f4-56bc118d525a service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:34.597261 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-99556b03-6e2e-44c2-92a0-e8bb411bb81f req-3c6e5271-8e51-46ab-98f4-56bc118d525a service nova] Creating event network-vif-plugged:f9f7f9cc-3fd7-49f4-b8f2-59f247cf93e3 for instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 on hv-cinder-85083 Jul 25 05:59:34.603280 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-99556b03-6e2e-44c2-92a0-e8bb411bb81f req-3c6e5271-8e51-46ab-98f4-56bc118d525a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060104 Jul 25 05:59:34.603887 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 86/168] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 05:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:34.856170 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-67d8a6b6-cace-47e3-8514-ddbca338898f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:34.856782 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-67d8a6b6-cace-47e3-8514-ddbca338898f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:34.858824 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=100 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:34.863570 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-67d8a6b6-cace-47e3-8514-ddbca338898f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:34.864015 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-67d8a6b6-cace-47e3-8514-ddbca338898f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:34.872127 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-67d8a6b6-cace-47e3-8514-ddbca338898f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:34.872127 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-67d8a6b6-cace-47e3-8514-ddbca338898f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:34.956596 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-65ebc94f-ffce-4a31-97ef-76d8c2716fa4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:34.962946 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-65ebc94f-ffce-4a31-97ef-76d8c2716fa4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:34.970641 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-65ebc94f-ffce-4a31-97ef-76d8c2716fa4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:34.971078 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-65ebc94f-ffce-4a31-97ef-76d8c2716fa4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:34.971844 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-65ebc94f-ffce-4a31-97ef-76d8c2716fa4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:34.972273 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-65ebc94f-ffce-4a31-97ef-76d8c2716fa4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:35.061420 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-67d8a6b6-cace-47e3-8514-ddbca338898f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:35.072824 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-67d8a6b6-cace-47e3-8514-ddbca338898f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1364 microversion: 2.1 time: 0.220361 Jul 25 05:59:35.075120 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 83/169] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:34 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:35.137172 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-65ebc94f-ffce-4a31-97ef-76d8c2716fa4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:35.146907 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-65ebc94f-ffce-4a31-97ef-76d8c2716fa4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1516 microversion: 2.1 time: 0.195510 Jul 25 05:59:35.147324 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 87/170] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:34 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1516 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:35.165015 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-4095a2aa-b38c-47d3-809f-761562f5625e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:35.166189 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-4095a2aa-b38c-47d3-809f-761562f5625e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:35.173129 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4095a2aa-b38c-47d3-809f-761562f5625e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:35.173582 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4095a2aa-b38c-47d3-809f-761562f5625e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:35.174339 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4095a2aa-b38c-47d3-809f-761562f5625e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:35.174798 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4095a2aa-b38c-47d3-809f-761562f5625e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:35.231827 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ff580b01-c805-4c92-9da7-21f78fe00ecf tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:35.232561 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ff580b01-c805-4c92-9da7-21f78fe00ecf tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:35.239290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ff580b01-c805-4c92-9da7-21f78fe00ecf tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:35.240023 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ff580b01-c805-4c92-9da7-21f78fe00ecf tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:35.240987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ff580b01-c805-4c92-9da7-21f78fe00ecf tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:35.241482 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ff580b01-c805-4c92-9da7-21f78fe00ecf tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:35.251924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-4095a2aa-b38c-47d3-809f-761562f5625e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lazy-loading 'flavor' on Instance uuid 6af46a4c-7081-4329-bcb1-df497104456e {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:59:35.403623 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ff580b01-c805-4c92-9da7-21f78fe00ecf tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:35.422374 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ff580b01-c805-4c92-9da7-21f78fe00ecf tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1501 microversion: 2.1 time: 0.193178 Jul 25 05:59:35.424190 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 88/171] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:35 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1501 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:35.439820 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-df1ab9c0-4d92-47fb-8769-9ecf5b58240f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:35.440520 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-df1ab9c0-4d92-47fb-8769-9ecf5b58240f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:35.447861 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-df1ab9c0-4d92-47fb-8769-9ecf5b58240f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:35.448837 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-df1ab9c0-4d92-47fb-8769-9ecf5b58240f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:35.449671 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-df1ab9c0-4d92-47fb-8769-9ecf5b58240f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:35.450153 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-df1ab9c0-4d92-47fb-8769-9ecf5b58240f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:35.591126 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-df1ab9c0-4d92-47fb-8769-9ecf5b58240f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:35.599924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-df1ab9c0-4d92-47fb-8769-9ecf5b58240f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:35.601417 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-df1ab9c0-4d92-47fb-8769-9ecf5b58240f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:35.602530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-df1ab9c0-4d92-47fb-8769-9ecf5b58240f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.176940 Jul 25 05:59:35.603082 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 89/172] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:35 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:35.607571 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-0919b7b2-eb4e-4a45-ab79-5b4456a6ba4c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:35.608161 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-0919b7b2-eb4e-4a45-ab79-5b4456a6ba4c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:35.613919 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0919b7b2-eb4e-4a45-ab79-5b4456a6ba4c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:35.614562 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0919b7b2-eb4e-4a45-ab79-5b4456a6ba4c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:35.616172 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0919b7b2-eb4e-4a45-ab79-5b4456a6ba4c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:35.616172 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0919b7b2-eb4e-4a45-ab79-5b4456a6ba4c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:35.640005 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-4095a2aa-b38c-47d3-809f-761562f5625e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "POST /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e/action" status: 200 len: 32 microversion: 2.1 time: 0.479385 Jul 25 05:59:35.646028 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 84/173] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 05:59:35 2022] POST /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e/action => generated 32 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 05:59:35.651628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e5abab9e-781c-4456-94e0-3418c618a78d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:35.652327 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e5abab9e-781c-4456-94e0-3418c618a78d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:35.659162 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e5abab9e-781c-4456-94e0-3418c618a78d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:35.659601 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e5abab9e-781c-4456-94e0-3418c618a78d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:35.660529 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e5abab9e-781c-4456-94e0-3418c618a78d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:35.661218 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e5abab9e-781c-4456-94e0-3418c618a78d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:35.788259 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-0919b7b2-eb4e-4a45-ab79-5b4456a6ba4c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:35.811048 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e5abab9e-781c-4456-94e0-3418c618a78d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:35.815541 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-0919b7b2-eb4e-4a45-ab79-5b4456a6ba4c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1367 microversion: 2.1 time: 0.211356 Jul 25 05:59:35.836187 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 90/174] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:35 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:35.848023 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e5abab9e-781c-4456-94e0-3418c618a78d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.200481 Jul 25 05:59:35.850569 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 85/175] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:35 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:36.090989 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4a3ad8cc-6731-4d8b-833f-8f61fc3089c5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:36.091602 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4a3ad8cc-6731-4d8b-833f-8f61fc3089c5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:36.097819 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4a3ad8cc-6731-4d8b-833f-8f61fc3089c5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:36.110166 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4a3ad8cc-6731-4d8b-833f-8f61fc3089c5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:36.110166 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4a3ad8cc-6731-4d8b-833f-8f61fc3089c5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:36.110166 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4a3ad8cc-6731-4d8b-833f-8f61fc3089c5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:36.264178 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4a3ad8cc-6731-4d8b-833f-8f61fc3089c5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:36.272772 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4a3ad8cc-6731-4d8b-833f-8f61fc3089c5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1364 microversion: 2.1 time: 0.185380 Jul 25 05:59:36.273344 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 91/176] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:36 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:36.621840 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-759615f2-81e8-4a67-9f49-b1f1f58999cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:36.628094 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-f68f4465-dc6d-4291-94c4-893841cfd1cf req-1173ee0a-8d51-4bf8-91d8-1999a2789fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b706acf-4c08-4ea0-8086-3091278ad437", "name": "network-vif-plugged", "status": "completed", "tag": "1e1fdc90-5262-49b6-b5ce-47ed89f39541"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:36.631282 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-759615f2-81e8-4a67-9f49-b1f1f58999cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:36.644390 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-759615f2-81e8-4a67-9f49-b1f1f58999cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:36.645060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-759615f2-81e8-4a67-9f49-b1f1f58999cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:36.645409 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-f68f4465-dc6d-4291-94c4-893841cfd1cf req-1173ee0a-8d51-4bf8-91d8-1999a2789fe2 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:36.645883 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-f68f4465-dc6d-4291-94c4-893841cfd1cf req-1173ee0a-8d51-4bf8-91d8-1999a2789fe2 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:36.650189 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-759615f2-81e8-4a67-9f49-b1f1f58999cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:36.650189 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-759615f2-81e8-4a67-9f49-b1f1f58999cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:36.659174 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-f68f4465-dc6d-4291-94c4-893841cfd1cf req-1173ee0a-8d51-4bf8-91d8-1999a2789fe2 service nova] Creating event network-vif-plugged:1e1fdc90-5262-49b6-b5ce-47ed89f39541 for instance 0b706acf-4c08-4ea0-8086-3091278ad437 on hv-cinder-85083 Jul 25 05:59:36.664213 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-f68f4465-dc6d-4291-94c4-893841cfd1cf req-1173ee0a-8d51-4bf8-91d8-1999a2789fe2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039958 Jul 25 05:59:36.664885 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 92/177] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 05:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:59:36.802298 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-759615f2-81e8-4a67-9f49-b1f1f58999cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:36.810793 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-759615f2-81e8-4a67-9f49-b1f1f58999cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:36.812359 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-759615f2-81e8-4a67-9f49-b1f1f58999cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:36.813465 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-759615f2-81e8-4a67-9f49-b1f1f58999cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1405 microversion: 2.20 time: 0.197548 Jul 25 05:59:36.814219 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 86/178] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:36 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1405 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:59:36.857987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-95e4631f-e18c-4907-83e7-431cc36342aa tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:36.858730 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-95e4631f-e18c-4907-83e7-431cc36342aa tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:36.865796 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0ee41baa-03d2-4179-bbbd-e6f0e5c0fe5b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:36.866404 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0ee41baa-03d2-4179-bbbd-e6f0e5c0fe5b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:36.872973 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0ee41baa-03d2-4179-bbbd-e6f0e5c0fe5b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:36.873729 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0ee41baa-03d2-4179-bbbd-e6f0e5c0fe5b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:36.873857 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-95e4631f-e18c-4907-83e7-431cc36342aa tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:36.874222 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-95e4631f-e18c-4907-83e7-431cc36342aa tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:36.875108 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-95e4631f-e18c-4907-83e7-431cc36342aa tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:36.875220 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0ee41baa-03d2-4179-bbbd-e6f0e5c0fe5b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:36.875540 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-95e4631f-e18c-4907-83e7-431cc36342aa tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:36.875958 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0ee41baa-03d2-4179-bbbd-e6f0e5c0fe5b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:37.026078 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-95e4631f-e18c-4907-83e7-431cc36342aa tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:37.033500 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0ee41baa-03d2-4179-bbbd-e6f0e5c0fe5b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:37.035729 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-95e4631f-e18c-4907-83e7-431cc36342aa tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1555 microversion: 2.1 time: 0.182742 Jul 25 05:59:37.036592 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 93/179] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:36 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1555 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:37.041552 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0ee41baa-03d2-4179-bbbd-e6f0e5c0fe5b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.179403 Jul 25 05:59:37.051492 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 87/180] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:36 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:37.056904 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-90fe6bf3-7f34-46ef-a2f7-5c25b78ea0dc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:37.057365 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-90fe6bf3-7f34-46ef-a2f7-5c25b78ea0dc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:37.063309 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-90fe6bf3-7f34-46ef-a2f7-5c25b78ea0dc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:37.063749 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-90fe6bf3-7f34-46ef-a2f7-5c25b78ea0dc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:37.064500 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-90fe6bf3-7f34-46ef-a2f7-5c25b78ea0dc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:37.064926 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-90fe6bf3-7f34-46ef-a2f7-5c25b78ea0dc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:37.182279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-90fe6bf3-7f34-46ef-a2f7-5c25b78ea0dc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129046 Jul 25 05:59:37.183135 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 94/181] 10.222.0.17 () {58 vars in 1274 bytes} [Mon Jul 25 05:59:37 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:37.290667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cd80f46f-508d-4b76-a562-06d086530da1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:37.291762 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-cd80f46f-508d-4b76-a562-06d086530da1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:37.304973 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd80f46f-508d-4b76-a562-06d086530da1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:37.305425 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd80f46f-508d-4b76-a562-06d086530da1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:37.306201 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd80f46f-508d-4b76-a562-06d086530da1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:37.313906 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd80f46f-508d-4b76-a562-06d086530da1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:37.329938 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:37.355067 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e6e0d9cb-b977-4cfe-bc91-2fbb9c18f08a tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "952cbc18-60c3-4e1a-bb65-2576bcf48cab"}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:37.356169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e6e0d9cb-b977-4cfe-bc91-2fbb9c18f08a tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:37.369653 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e6e0d9cb-b977-4cfe-bc91-2fbb9c18f08a tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:37.370335 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e6e0d9cb-b977-4cfe-bc91-2fbb9c18f08a tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:37.371279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e6e0d9cb-b977-4cfe-bc91-2fbb9c18f08a tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:37.378193 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e6e0d9cb-b977-4cfe-bc91-2fbb9c18f08a tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:38.109644 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cd80f46f-508d-4b76-a562-06d086530da1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:38.124433 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-cd80f46f-508d-4b76-a562-06d086530da1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1364 microversion: 2.1 time: 0.838254 Jul 25 05:59:38.125746 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 88/182] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:37 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1364 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:38.131886 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cd70562d-e5a8-486d-81db-1d51f6bd4590 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:38.132970 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-cd70562d-e5a8-486d-81db-1d51f6bd4590 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:38.140955 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd70562d-e5a8-486d-81db-1d51f6bd4590 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:38.141844 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd70562d-e5a8-486d-81db-1d51f6bd4590 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:38.143256 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd70562d-e5a8-486d-81db-1d51f6bd4590 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:38.144317 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd70562d-e5a8-486d-81db-1d51f6bd4590 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:38.525233 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e6e0d9cb-b977-4cfe-bc91-2fbb9c18f08a tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "POST /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.157607 Jul 25 05:59:38.525233 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 95/183] 10.222.0.17 () {60 vars in 1322 bytes} [Mon Jul 25 05:59:37 2022] POST /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305/os-volume_attachments => generated 194 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:59:38.525233 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d4d049ee-907b-49c4-80ce-cc28a6076139 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:38.525233 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d4d049ee-907b-49c4-80ce-cc28a6076139 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:38.529535 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d4d049ee-907b-49c4-80ce-cc28a6076139 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:38.530003 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d4d049ee-907b-49c4-80ce-cc28a6076139 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:38.531531 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d4d049ee-907b-49c4-80ce-cc28a6076139 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:38.532036 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d4d049ee-907b-49c4-80ce-cc28a6076139 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:38.685418 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d4d049ee-907b-49c4-80ce-cc28a6076139 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:38.693481 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d4d049ee-907b-49c4-80ce-cc28a6076139 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.181977 Jul 25 05:59:38.694187 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 96/184] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:38 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:38.798918 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cd70562d-e5a8-486d-81db-1d51f6bd4590 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:38.807692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cd70562d-e5a8-486d-81db-1d51f6bd4590 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:38.809210 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cd70562d-e5a8-486d-81db-1d51f6bd4590 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:38.810422 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-cd70562d-e5a8-486d-81db-1d51f6bd4590 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1596 microversion: 2.20 time: 0.683440 Jul 25 05:59:38.811006 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 89/185] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:38 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1596 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:38.830146 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2a09d5a2-fcd7-468a-b741-4f6cbd38eb18 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:38.830669 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2a09d5a2-fcd7-468a-b741-4f6cbd38eb18 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:38.836733 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2a09d5a2-fcd7-468a-b741-4f6cbd38eb18 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:38.837189 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2a09d5a2-fcd7-468a-b741-4f6cbd38eb18 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:38.837949 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2a09d5a2-fcd7-468a-b741-4f6cbd38eb18 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:38.838585 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2a09d5a2-fcd7-468a-b741-4f6cbd38eb18 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:38.856418 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:38.933890 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2a09d5a2-fcd7-468a-b741-4f6cbd38eb18 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.108302 Jul 25 05:59:38.934829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 97/186] 10.222.0.17 () {60 vars in 1315 bytes} [Mon Jul 25 05:59:38 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:59:39.143705 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3412e3cc-4330-477f-ac7e-0b1af70a9eee tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:39.145006 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3412e3cc-4330-477f-ac7e-0b1af70a9eee tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:39.159614 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3412e3cc-4330-477f-ac7e-0b1af70a9eee tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:39.160349 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3412e3cc-4330-477f-ac7e-0b1af70a9eee tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:39.162610 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3412e3cc-4330-477f-ac7e-0b1af70a9eee tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:39.163235 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3412e3cc-4330-477f-ac7e-0b1af70a9eee tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:39.716832 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e70accc9-522f-42a5-b13d-c5c117600509 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:39.718188 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e70accc9-522f-42a5-b13d-c5c117600509 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:39.727190 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e70accc9-522f-42a5-b13d-c5c117600509 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:39.733404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e70accc9-522f-42a5-b13d-c5c117600509 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:39.733404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e70accc9-522f-42a5-b13d-c5c117600509 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:39.733404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e70accc9-522f-42a5-b13d-c5c117600509 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:39.912009 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3412e3cc-4330-477f-ac7e-0b1af70a9eee tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:39.923370 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3412e3cc-4330-477f-ac7e-0b1af70a9eee tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1364 microversion: 2.1 time: 0.785822 Jul 25 05:59:39.934260 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 90/187] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:39 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1364 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:40.153328 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e70accc9-522f-42a5-b13d-c5c117600509 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:40.163225 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e70accc9-522f-42a5-b13d-c5c117600509 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.455446 Jul 25 05:59:40.164083 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 98/188] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:39 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:40.395156 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-4b3984ae-cb39-449e-88c7-41723f154949 req-6ac3409f-f2db-4a7f-99b9-b92b09fa8317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "479a7885-4c31-448b-8d0d-42049d47896f", "tag": "70a76596-074b-4a73-b7c5-338b9b7a51d2"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:40.403540 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-4b3984ae-cb39-449e-88c7-41723f154949 req-6ac3409f-f2db-4a7f-99b9-b92b09fa8317 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:40.404163 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-4b3984ae-cb39-449e-88c7-41723f154949 req-6ac3409f-f2db-4a7f-99b9-b92b09fa8317 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:40.417034 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-4b3984ae-cb39-449e-88c7-41723f154949 req-6ac3409f-f2db-4a7f-99b9-b92b09fa8317 service nova] Creating event network-changed:70a76596-074b-4a73-b7c5-338b9b7a51d2 for instance 479a7885-4c31-448b-8d0d-42049d47896f on hv-cinder-85083 Jul 25 05:59:40.423761 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-4b3984ae-cb39-449e-88c7-41723f154949 req-6ac3409f-f2db-4a7f-99b9-b92b09fa8317 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031955 Jul 25 05:59:40.425055 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 91/189] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 05:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:40.947722 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d0eede26-a84c-4555-b9f4-7f5444abbf69 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:40.951092 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d0eede26-a84c-4555-b9f4-7f5444abbf69 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:40.976027 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-9c61030d-52a9-43e2-90e3-74d4265db1ca req-3c56ca03-3c0c-41ad-8e59-d61a61a4f612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "348f256d-41e5-47d8-b165-cad6dfcd0be9", "tag": "f9f7f9cc-3fd7-49f4-b8f2-59f247cf93e3"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:40.987126 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-9c61030d-52a9-43e2-90e3-74d4265db1ca req-3c56ca03-3c0c-41ad-8e59-d61a61a4f612 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:40.987925 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-9c61030d-52a9-43e2-90e3-74d4265db1ca req-3c56ca03-3c0c-41ad-8e59-d61a61a4f612 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:40.997893 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d0eede26-a84c-4555-b9f4-7f5444abbf69 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:41.000525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d0eede26-a84c-4555-b9f4-7f5444abbf69 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:41.001370 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d0eede26-a84c-4555-b9f4-7f5444abbf69 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:41.001808 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d0eede26-a84c-4555-b9f4-7f5444abbf69 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:41.004157 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-9c61030d-52a9-43e2-90e3-74d4265db1ca req-3c56ca03-3c0c-41ad-8e59-d61a61a4f612 service nova] Creating event network-changed:f9f7f9cc-3fd7-49f4-b8f2-59f247cf93e3 for instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 on hv-cinder-85083 Jul 25 05:59:41.012661 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-9c61030d-52a9-43e2-90e3-74d4265db1ca req-3c56ca03-3c0c-41ad-8e59-d61a61a4f612 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040648 Jul 25 05:59:41.016175 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 92/190] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 05:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:41.182422 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0a23b394-86ae-43d1-9b4e-3905aa99bf19 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:41.183612 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0a23b394-86ae-43d1-9b4e-3905aa99bf19 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:41.198328 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0a23b394-86ae-43d1-9b4e-3905aa99bf19 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:41.199589 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0a23b394-86ae-43d1-9b4e-3905aa99bf19 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:41.202587 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0a23b394-86ae-43d1-9b4e-3905aa99bf19 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:41.204463 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0a23b394-86ae-43d1-9b4e-3905aa99bf19 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:41.251563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d0eede26-a84c-4555-b9f4-7f5444abbf69 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:41.262533 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d0eede26-a84c-4555-b9f4-7f5444abbf69 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1551 microversion: 2.1 time: 0.324770 Jul 25 05:59:41.276053 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 99/191] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:40 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1551 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:41.285792 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-731cd035-21d9-4b4a-abc0-b6ec22a03f7a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:41.286392 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-731cd035-21d9-4b4a-abc0-b6ec22a03f7a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:41.316758 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-731cd035-21d9-4b4a-abc0-b6ec22a03f7a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:41.319170 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-731cd035-21d9-4b4a-abc0-b6ec22a03f7a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:41.319978 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-731cd035-21d9-4b4a-abc0-b6ec22a03f7a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:41.320560 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-731cd035-21d9-4b4a-abc0-b6ec22a03f7a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:41.486187 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-731cd035-21d9-4b4a-abc0-b6ec22a03f7a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.208235 Jul 25 05:59:41.486820 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 100/192] 10.222.0.17 () {58 vars in 1274 bytes} [Mon Jul 25 05:59:41 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/os-interface => generated 285 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:41.671442 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0a23b394-86ae-43d1-9b4e-3905aa99bf19 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:41.686264 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0a23b394-86ae-43d1-9b4e-3905aa99bf19 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.508569 Jul 25 05:59:41.697357 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 93/193] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:41 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:42.708195 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-78f91371-1a3c-4758-966a-47b90bd17877 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:42.708944 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-78f91371-1a3c-4758-966a-47b90bd17877 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:42.724715 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-78f91371-1a3c-4758-966a-47b90bd17877 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:42.725343 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-78f91371-1a3c-4758-966a-47b90bd17877 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:42.726311 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-78f91371-1a3c-4758-966a-47b90bd17877 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:42.727069 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-78f91371-1a3c-4758-966a-47b90bd17877 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:43.258935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-78f91371-1a3c-4758-966a-47b90bd17877 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:43.278946 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-78f91371-1a3c-4758-966a-47b90bd17877 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.569067 Jul 25 05:59:43.280229 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 101/194] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:42 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:43.601447 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-8ea895c4-b9a9-4e9b-aa72-c5b9d7152ebf req-2bdccdcc-2da9-4c15-83cb-f51ad6275da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b706acf-4c08-4ea0-8086-3091278ad437", "tag": "1e1fdc90-5262-49b6-b5ce-47ed89f39541"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:43.635792 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-8ea895c4-b9a9-4e9b-aa72-c5b9d7152ebf req-2bdccdcc-2da9-4c15-83cb-f51ad6275da7 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:43.637715 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-8ea895c4-b9a9-4e9b-aa72-c5b9d7152ebf req-2bdccdcc-2da9-4c15-83cb-f51ad6275da7 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:43.661435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-8ea895c4-b9a9-4e9b-aa72-c5b9d7152ebf req-2bdccdcc-2da9-4c15-83cb-f51ad6275da7 service nova] Creating event network-changed:1e1fdc90-5262-49b6-b5ce-47ed89f39541 for instance 0b706acf-4c08-4ea0-8086-3091278ad437 on hv-cinder-85083 Jul 25 05:59:43.676862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-8ea895c4-b9a9-4e9b-aa72-c5b9d7152ebf req-2bdccdcc-2da9-4c15-83cb-f51ad6275da7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086108 Jul 25 05:59:43.684449 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 94/195] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 05:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:44.297818 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-823aa325-4c89-484b-95b7-6fdfd93689de tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:44.298607 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-823aa325-4c89-484b-95b7-6fdfd93689de tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:44.305598 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-823aa325-4c89-484b-95b7-6fdfd93689de tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:44.306178 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-823aa325-4c89-484b-95b7-6fdfd93689de tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:44.307302 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-823aa325-4c89-484b-95b7-6fdfd93689de tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:44.307834 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-823aa325-4c89-484b-95b7-6fdfd93689de tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:44.554688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-823aa325-4c89-484b-95b7-6fdfd93689de tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:44.562362 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-823aa325-4c89-484b-95b7-6fdfd93689de tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.269212 Jul 25 05:59:44.562962 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 102/196] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:44 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:45.587993 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-82f75211-36e7-4af0-9fd4-ff0230966763 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:45.590098 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-82f75211-36e7-4af0-9fd4-ff0230966763 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:45.597757 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-82f75211-36e7-4af0-9fd4-ff0230966763 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:45.600193 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-82f75211-36e7-4af0-9fd4-ff0230966763 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:45.601755 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-82f75211-36e7-4af0-9fd4-ff0230966763 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:45.602529 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-82f75211-36e7-4af0-9fd4-ff0230966763 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:45.777244 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-82f75211-36e7-4af0-9fd4-ff0230966763 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:45.788854 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-82f75211-36e7-4af0-9fd4-ff0230966763 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.213192 Jul 25 05:59:45.790145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 95/197] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:45 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:46.812323 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-73d54500-c32f-40af-b24a-2b3481fa50f1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:46.812323 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-73d54500-c32f-40af-b24a-2b3481fa50f1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:46.812931 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-73d54500-c32f-40af-b24a-2b3481fa50f1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:46.813203 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-73d54500-c32f-40af-b24a-2b3481fa50f1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:46.813989 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-73d54500-c32f-40af-b24a-2b3481fa50f1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:46.814426 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-73d54500-c32f-40af-b24a-2b3481fa50f1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:46.948015 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-73d54500-c32f-40af-b24a-2b3481fa50f1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:46.956399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-73d54500-c32f-40af-b24a-2b3481fa50f1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.155086 Jul 25 05:59:46.957085 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 103/198] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:46 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:47.975036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-398dc435-9722-49ba-b0c6-25aa1987ea4e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:47.975800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-398dc435-9722-49ba-b0c6-25aa1987ea4e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:47.981814 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-398dc435-9722-49ba-b0c6-25aa1987ea4e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:47.982259 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-398dc435-9722-49ba-b0c6-25aa1987ea4e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:47.983047 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-398dc435-9722-49ba-b0c6-25aa1987ea4e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:47.984224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-398dc435-9722-49ba-b0c6-25aa1987ea4e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:48.197384 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-398dc435-9722-49ba-b0c6-25aa1987ea4e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:48.197384 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-398dc435-9722-49ba-b0c6-25aa1987ea4e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.161414 Jul 25 05:59:48.197384 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 96/199] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:47 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:49.205803 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f37fda43-51b2-474d-b4bc-6ad1c5dc8a6c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:49.206500 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f37fda43-51b2-474d-b4bc-6ad1c5dc8a6c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:49.213004 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f37fda43-51b2-474d-b4bc-6ad1c5dc8a6c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:49.213450 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f37fda43-51b2-474d-b4bc-6ad1c5dc8a6c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:49.214207 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f37fda43-51b2-474d-b4bc-6ad1c5dc8a6c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:49.214706 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f37fda43-51b2-474d-b4bc-6ad1c5dc8a6c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:49.348755 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f37fda43-51b2-474d-b4bc-6ad1c5dc8a6c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:49.356550 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f37fda43-51b2-474d-b4bc-6ad1c5dc8a6c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.155160 Jul 25 05:59:49.358649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 104/200] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:49 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:49.451443 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-43f97f61-6f21-4a6e-a534-d2d7a567bfe4 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:49.451953 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-43f97f61-6f21-4a6e-a534-d2d7a567bfe4 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:49.458616 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-43f97f61-6f21-4a6e-a534-d2d7a567bfe4 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:49.461692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-43f97f61-6f21-4a6e-a534-d2d7a567bfe4 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:49.461692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-43f97f61-6f21-4a6e-a534-d2d7a567bfe4 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:49.461692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-43f97f61-6f21-4a6e-a534-d2d7a567bfe4 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:49.485114 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-43f97f61-6f21-4a6e-a534-d2d7a567bfe4 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Going to try to terminate instance {{(pid=130162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:59:49.767293 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-43f97f61-6f21-4a6e-a534-d2d7a567bfe4 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "DELETE /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 204 len: 0 microversion: 2.1 time: 0.319373 Jul 25 05:59:49.777093 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3b52edef-35da-4c2e-ab2b-77c667dc89e0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:49.777093 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-3b52edef-35da-4c2e-ab2b-77c667dc89e0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:49.777286 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 97/201] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 05:59:49 2022] DELETE /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:59:49.783834 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3b52edef-35da-4c2e-ab2b-77c667dc89e0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:49.784477 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3b52edef-35da-4c2e-ab2b-77c667dc89e0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:49.785232 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3b52edef-35da-4c2e-ab2b-77c667dc89e0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:49.785817 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3b52edef-35da-4c2e-ab2b-77c667dc89e0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:49.929317 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3b52edef-35da-4c2e-ab2b-77c667dc89e0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:49.939356 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-3b52edef-35da-4c2e-ab2b-77c667dc89e0 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1553 microversion: 2.1 time: 0.167001 Jul 25 05:59:49.940145 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 105/202] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:49 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:50.374245 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a93ae974-a8f3-4017-a0b6-434582cb721a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:50.375003 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a93ae974-a8f3-4017-a0b6-434582cb721a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:50.382456 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a93ae974-a8f3-4017-a0b6-434582cb721a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:50.383146 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a93ae974-a8f3-4017-a0b6-434582cb721a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:50.383920 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a93ae974-a8f3-4017-a0b6-434582cb721a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:50.384364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a93ae974-a8f3-4017-a0b6-434582cb721a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:50.542095 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-a93ae974-a8f3-4017-a0b6-434582cb721a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:50.550348 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a93ae974-a8f3-4017-a0b6-434582cb721a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.180264 Jul 25 05:59:50.551122 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 98/203] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:50 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:50.957061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-74fc861b-df78-4e7c-abc9-8e01519a588f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:50.957673 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-74fc861b-df78-4e7c-abc9-8e01519a588f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:50.963848 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-74fc861b-df78-4e7c-abc9-8e01519a588f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:50.964341 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-74fc861b-df78-4e7c-abc9-8e01519a588f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:50.965101 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-74fc861b-df78-4e7c-abc9-8e01519a588f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:50.965535 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-74fc861b-df78-4e7c-abc9-8e01519a588f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:51.095588 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-74fc861b-df78-4e7c-abc9-8e01519a588f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:51.103671 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-74fc861b-df78-4e7c-abc9-8e01519a588f tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1553 microversion: 2.1 time: 0.150574 Jul 25 05:59:51.104248 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 106/204] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:50 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:51.567145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d651776b-664b-4340-a69d-650c043c7360 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:51.567759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d651776b-664b-4340-a69d-650c043c7360 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:51.573786 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d651776b-664b-4340-a69d-650c043c7360 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:51.574252 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d651776b-664b-4340-a69d-650c043c7360 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:51.575031 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d651776b-664b-4340-a69d-650c043c7360 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:51.575494 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d651776b-664b-4340-a69d-650c043c7360 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:51.712636 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d651776b-664b-4340-a69d-650c043c7360 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:51.720872 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d651776b-664b-4340-a69d-650c043c7360 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.158169 Jul 25 05:59:51.721474 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 99/205] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:51 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:52.121286 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-bc2cbeda-5e84-4fd1-994a-b2ca22eaaae4 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:52.121919 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-bc2cbeda-5e84-4fd1-994a-b2ca22eaaae4 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:52.128994 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bc2cbeda-5e84-4fd1-994a-b2ca22eaaae4 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:52.129447 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bc2cbeda-5e84-4fd1-994a-b2ca22eaaae4 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:52.130168 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bc2cbeda-5e84-4fd1-994a-b2ca22eaaae4 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:52.130623 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bc2cbeda-5e84-4fd1-994a-b2ca22eaaae4 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:52.277060 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-bc2cbeda-5e84-4fd1-994a-b2ca22eaaae4 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:52.285536 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-bc2cbeda-5e84-4fd1-994a-b2ca22eaaae4 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1553 microversion: 2.1 time: 0.168872 Jul 25 05:59:52.286297 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 107/206] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:52 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:52.737790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-00421c78-62cb-4c47-8fb2-cbbad8058399 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:52.739718 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-00421c78-62cb-4c47-8fb2-cbbad8058399 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:52.744598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-00421c78-62cb-4c47-8fb2-cbbad8058399 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:52.744983 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-00421c78-62cb-4c47-8fb2-cbbad8058399 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:52.745818 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-00421c78-62cb-4c47-8fb2-cbbad8058399 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:52.746253 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-00421c78-62cb-4c47-8fb2-cbbad8058399 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:52.942370 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-00421c78-62cb-4c47-8fb2-cbbad8058399 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:52.950648 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-00421c78-62cb-4c47-8fb2-cbbad8058399 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.217139 Jul 25 05:59:52.951233 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 100/207] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:52 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:53.103907 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-7dd45a5f-9037-4f88-bd72-065314a027ce req-66bb402e-a796-434b-8dcc-e8616d4dbb0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57462ad3-d5fc-4dee-9087-afc18c4f0305", "name": "network-vif-deleted", "tag": "01a10501-1421-4069-8834-45e48a9bab40"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:53.113315 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-7dd45a5f-9037-4f88-bd72-065314a027ce req-66bb402e-a796-434b-8dcc-e8616d4dbb0e service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:53.113800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-7dd45a5f-9037-4f88-bd72-065314a027ce req-66bb402e-a796-434b-8dcc-e8616d4dbb0e service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:53.126521 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-7dd45a5f-9037-4f88-bd72-065314a027ce req-66bb402e-a796-434b-8dcc-e8616d4dbb0e service nova] Creating event network-vif-deleted:01a10501-1421-4069-8834-45e48a9bab40 for instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 on hv-cinder-85083 Jul 25 05:59:53.136364 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-7dd45a5f-9037-4f88-bd72-065314a027ce req-66bb402e-a796-434b-8dcc-e8616d4dbb0e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034005 Jul 25 05:59:53.136364 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 108/208] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 05:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:53.313269 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d4184cde-dbf3-47f7-9d94-0cdf57491928 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:53.313269 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d4184cde-dbf3-47f7-9d94-0cdf57491928 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:53.313269 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d4184cde-dbf3-47f7-9d94-0cdf57491928 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:53.313269 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d4184cde-dbf3-47f7-9d94-0cdf57491928 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:53.314128 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d4184cde-dbf3-47f7-9d94-0cdf57491928 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:53.314128 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d4184cde-dbf3-47f7-9d94-0cdf57491928 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:53.380227 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d4184cde-dbf3-47f7-9d94-0cdf57491928 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:53.388655 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d4184cde-dbf3-47f7-9d94-0cdf57491928 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1346 microversion: 2.1 time: 0.089066 Jul 25 05:59:53.389226 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 101/209] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:53 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:53.967643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4aa96c38-1a93-42cb-8cf7-333189911099 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:53.968349 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4aa96c38-1a93-42cb-8cf7-333189911099 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:53.980010 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4aa96c38-1a93-42cb-8cf7-333189911099 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:53.980492 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4aa96c38-1a93-42cb-8cf7-333189911099 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:53.981243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4aa96c38-1a93-42cb-8cf7-333189911099 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:53.981682 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4aa96c38-1a93-42cb-8cf7-333189911099 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:54.130050 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4aa96c38-1a93-42cb-8cf7-333189911099 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:54.137844 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4aa96c38-1a93-42cb-8cf7-333189911099 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.174542 Jul 25 05:59:54.138528 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 109/210] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:53 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:54.405516 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9e8c9b7a-b942-47d7-9f1f-d86f0cfbf626 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:54.406126 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-9e8c9b7a-b942-47d7-9f1f-d86f0cfbf626 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:54.412662 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9e8c9b7a-b942-47d7-9f1f-d86f0cfbf626 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:54.413465 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9e8c9b7a-b942-47d7-9f1f-d86f0cfbf626 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:54.414399 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9e8c9b7a-b942-47d7-9f1f-d86f0cfbf626 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:54.414856 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9e8c9b7a-b942-47d7-9f1f-d86f0cfbf626 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:54.450018 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9e8c9b7a-b942-47d7-9f1f-d86f0cfbf626 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:54.450735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9e8c9b7a-b942-47d7-9f1f-d86f0cfbf626 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:54.466165 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-9e8c9b7a-b942-47d7-9f1f-d86f0cfbf626 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lazy-loading 'fault' on Instance uuid 57462ad3-d5fc-4dee-9087-afc18c4f0305 {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:59:54.506461 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-9e8c9b7a-b942-47d7-9f1f-d86f0cfbf626 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc10b641e34490a83bc587262f4c61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb20b5f0088f4a1c84f17ddb49d851a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:54.518343 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-9e8c9b7a-b942-47d7-9f1f-d86f0cfbf626 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 200 len: 1351 microversion: 2.1 time: 0.114988 Jul 25 05:59:54.519232 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 102/211] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:54 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 1351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:55.160282 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-fc4bd78b-6d4b-449c-bde2-f1bccc7b0e18 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:55.160938 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-fc4bd78b-6d4b-449c-bde2-f1bccc7b0e18 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:55.167974 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fc4bd78b-6d4b-449c-bde2-f1bccc7b0e18 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:55.168414 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fc4bd78b-6d4b-449c-bde2-f1bccc7b0e18 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:55.169157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fc4bd78b-6d4b-449c-bde2-f1bccc7b0e18 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:55.169586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fc4bd78b-6d4b-449c-bde2-f1bccc7b0e18 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:55.313583 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-fc4bd78b-6d4b-449c-bde2-f1bccc7b0e18 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:55.320921 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-fc4bd78b-6d4b-449c-bde2-f1bccc7b0e18 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.165061 Jul 25 05:59:55.321496 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 110/212] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:55 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:55.537665 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-bd4f25e2-9e26-41a0-8bbd-4670874a0197 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:55.538282 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-bd4f25e2-9e26-41a0-8bbd-4670874a0197 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:55.544257 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bd4f25e2-9e26-41a0-8bbd-4670874a0197 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:55.544692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bd4f25e2-9e26-41a0-8bbd-4670874a0197 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:55.545430 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bd4f25e2-9e26-41a0-8bbd-4670874a0197 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:55.545856 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bd4f25e2-9e26-41a0-8bbd-4670874a0197 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:55.559006 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-bd4f25e2-9e26-41a0-8bbd-4670874a0197 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] HTTP exception thrown: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-bd4f25e2-9e26-41a0-8bbd-4670874a0197 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Request method failure captured: Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 HTTP/1.1 Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEdWuRHlFT_EdZ_z1O_RZCFo7ZMnR_gZlkpCNjkzahZuspG-ndDXYAKnRm9IyETbRArvU_XIRsNxEnq-yzdywrRauMgZrg4Zz264AO2kr5ZyJJVU6Ko0WNqpqFe0iJtC8SsHftoZUCzBdvgca226X8RXMGLsYsrx_Jd_HOseuG1azg Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: bb20b5f0088f4a1c84f17ddb49d851a7 Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-DeleteServersTestJSON-545890828 Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 05:59:55.571759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 05:59:55.573273 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb20b5f0088f4a1c84f17ddb49d851a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb20b5f0088f4a1c84f17ddb49d851a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb20b5f0088f4a1c84f17ddb49d851a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb20b5f0088f4a1c84f17ddb49d851a7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 05:59:55.573273 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-DeleteServersTestJSON-545890828 Jul 25 05:59:55.573273 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: bb20b5f0088f4a1c84f17ddb49d851a7 Jul 25 05:59:55.573273 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-DeleteServersTestJSON-545890828 Jul 25 05:59:55.573273 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-DeleteServersTestJSON-545890828-project Jul 25 05:59:55.573273 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 05:59:55.573273 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 05:59:55.573273 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 3bc10b641e34490a83bc587262f4c61a Jul 25 05:59:55.573273 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-DeleteServersTestJSON-545890828-project Jul 25 05:59:55.573273 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 05:59:55.573273 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:55.573273 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '57462ad3-d5fc-4dee-9087-afc18c4f0305'} Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:59:55.574139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:55.575561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 05:59:55.577002 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-bd4f25e2-9e26-41a0-8bbd-4670874a0197 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Returning 404 to user: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:59:55.577002 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-bd4f25e2-9e26-41a0-8bbd-4670874a0197 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 404 len: 111 microversion: 2.1 time: 0.039653 Jul 25 05:59:55.577002 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 103/213] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:55 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:59:55.679860 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a563189d-3fd1-4141-b54e-a2aae73352da tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:55.680779 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a563189d-3fd1-4141-b54e-a2aae73352da tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:55.690827 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a563189d-3fd1-4141-b54e-a2aae73352da tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:55.690827 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a563189d-3fd1-4141-b54e-a2aae73352da tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:55.690827 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a563189d-3fd1-4141-b54e-a2aae73352da tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:55.690827 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a563189d-3fd1-4141-b54e-a2aae73352da tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:55.701303 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-a563189d-3fd1-4141-b54e-a2aae73352da tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] HTTP exception thrown: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a563189d-3fd1-4141-b54e-a2aae73352da tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Request method failure captured: Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305/os-volume_attachments HTTP/1.1 Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEdWuRHlFT_EdZ_z1O_RZCFo7ZMnR_gZlkpCNjkzahZuspG-ndDXYAKnRm9IyETbRArvU_XIRsNxEnq-yzdywrRauMgZrg4Zz264AO2kr5ZyJJVU6Ko0WNqpqFe0iJtC8SsHftoZUCzBdvgca226X8RXMGLsYsrx_Jd_HOseuG1azg Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: bb20b5f0088f4a1c84f17ddb49d851a7 Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-DeleteServersTestJSON-545890828 Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 05:59:55.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 05:59:55.711825 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb20b5f0088f4a1c84f17ddb49d851a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb20b5f0088f4a1c84f17ddb49d851a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb20b5f0088f4a1c84f17ddb49d851a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb20b5f0088f4a1c84f17ddb49d851a7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 05:59:55.711825 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-DeleteServersTestJSON-545890828 Jul 25 05:59:55.711825 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: bb20b5f0088f4a1c84f17ddb49d851a7 Jul 25 05:59:55.711825 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-DeleteServersTestJSON-545890828 Jul 25 05:59:55.711825 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-DeleteServersTestJSON-545890828-project Jul 25 05:59:55.711825 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 05:59:55.711825 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 05:59:55.711825 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 3bc10b641e34490a83bc587262f4c61a Jul 25 05:59:55.711825 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-DeleteServersTestJSON-545890828-project Jul 25 05:59:55.711825 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 05:59:55.711825 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:55.711825 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'server_id': '57462ad3-d5fc-4dee-9087-afc18c4f0305'} Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:59:55.712593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:55.713924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:59:55.715293 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a563189d-3fd1-4141-b54e-a2aae73352da tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Returning 404 to user: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:59:55.715293 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a563189d-3fd1-4141-b54e-a2aae73352da tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036134 Jul 25 05:59:55.715293 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 111/214] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 05:59:55 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:59:56.345007 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-aa96e720-2533-4d77-897b-0b96c62cae73 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:56.345684 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-aa96e720-2533-4d77-897b-0b96c62cae73 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:56.354059 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aa96e720-2533-4d77-897b-0b96c62cae73 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:56.354700 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aa96e720-2533-4d77-897b-0b96c62cae73 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:56.355609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aa96e720-2533-4d77-897b-0b96c62cae73 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:56.356135 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aa96e720-2533-4d77-897b-0b96c62cae73 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:56.491805 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-aa96e720-2533-4d77-897b-0b96c62cae73 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:56.499516 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-aa96e720-2533-4d77-897b-0b96c62cae73 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.165097 Jul 25 05:59:56.500077 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 104/215] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:56 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:57.116039 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-1fd2b002-b659-4922-a0cd-df70da0fd682 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:57.116529 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-1fd2b002-b659-4922-a0cd-df70da0fd682 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:57.123646 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1fd2b002-b659-4922-a0cd-df70da0fd682 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:57.123772 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1fd2b002-b659-4922-a0cd-df70da0fd682 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:57.124486 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1fd2b002-b659-4922-a0cd-df70da0fd682 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:57.124917 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1fd2b002-b659-4922-a0cd-df70da0fd682 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:57.139738 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-1fd2b002-b659-4922-a0cd-df70da0fd682 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] HTTP exception thrown: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-1fd2b002-b659-4922-a0cd-df70da0fd682 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Request method failure captured: Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: DELETE /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 HTTP/1.1 Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEdWuRHlFT_EdZ_z1O_RZCFo7ZMnR_gZlkpCNjkzahZuspG-ndDXYAKnRm9IyETbRArvU_XIRsNxEnq-yzdywrRauMgZrg4Zz264AO2kr5ZyJJVU6Ko0WNqpqFe0iJtC8SsHftoZUCzBdvgca226X8RXMGLsYsrx_Jd_HOseuG1azg Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: bb20b5f0088f4a1c84f17ddb49d851a7 Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-DeleteServersTestJSON-545890828 Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 05:59:57.142515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 05:59:57.143774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb20b5f0088f4a1c84f17ddb49d851a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb20b5f0088f4a1c84f17ddb49d851a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb20b5f0088f4a1c84f17ddb49d851a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb20b5f0088f4a1c84f17ddb49d851a7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 05:59:57.143774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-DeleteServersTestJSON-545890828 Jul 25 05:59:57.143774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: bb20b5f0088f4a1c84f17ddb49d851a7 Jul 25 05:59:57.143774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-DeleteServersTestJSON-545890828 Jul 25 05:59:57.143774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-DeleteServersTestJSON-545890828-project Jul 25 05:59:57.143774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 05:59:57.143774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 05:59:57.143774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 3bc10b641e34490a83bc587262f4c61a Jul 25 05:59:57.143774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-DeleteServersTestJSON-545890828-project Jul 25 05:59:57.143774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 05:59:57.143774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:57.143774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '57462ad3-d5fc-4dee-9087-afc18c4f0305'} Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:59:57.144416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:57.146071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 05:59:57.147775 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-1fd2b002-b659-4922-a0cd-df70da0fd682 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Returning 404 to user: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:59:57.147775 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-1fd2b002-b659-4922-a0cd-df70da0fd682 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "DELETE /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 404 len: 111 microversion: 2.1 time: 0.031736 Jul 25 05:59:57.147775 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 112/216] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 05:59:57 2022] DELETE /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:59:57.152438 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-52ffcc37-1d70-4414-8733-005ac4b264a6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:57.155119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-52ffcc37-1d70-4414-8733-005ac4b264a6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] [instance: 57462ad3-d5fc-4dee-9087-afc18c4f0305] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:57.159648 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-52ffcc37-1d70-4414-8733-005ac4b264a6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:57.160092 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-52ffcc37-1d70-4414-8733-005ac4b264a6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:57.160856 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-52ffcc37-1d70-4414-8733-005ac4b264a6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:57.161289 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-52ffcc37-1d70-4414-8733-005ac4b264a6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:57.177432 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-52ffcc37-1d70-4414-8733-005ac4b264a6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] HTTP exception thrown: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-52ffcc37-1d70-4414-8733-005ac4b264a6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Request method failure captured: Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 HTTP/1.1 Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEdWuRHlFT_EdZ_z1O_RZCFo7ZMnR_gZlkpCNjkzahZuspG-ndDXYAKnRm9IyETbRArvU_XIRsNxEnq-yzdywrRauMgZrg4Zz264AO2kr5ZyJJVU6Ko0WNqpqFe0iJtC8SsHftoZUCzBdvgca226X8RXMGLsYsrx_Jd_HOseuG1azg Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: bb20b5f0088f4a1c84f17ddb49d851a7 Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-DeleteServersTestJSON-545890828 Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 05:59:57.178975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 05:59:57.187910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb20b5f0088f4a1c84f17ddb49d851a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb20b5f0088f4a1c84f17ddb49d851a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb20b5f0088f4a1c84f17ddb49d851a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb20b5f0088f4a1c84f17ddb49d851a7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 05:59:57.187910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-DeleteServersTestJSON-545890828 Jul 25 05:59:57.187910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: bb20b5f0088f4a1c84f17ddb49d851a7 Jul 25 05:59:57.187910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-DeleteServersTestJSON-545890828 Jul 25 05:59:57.187910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-DeleteServersTestJSON-545890828-project Jul 25 05:59:57.187910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 05:59:57.187910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 05:59:57.187910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 3bc10b641e34490a83bc587262f4c61a Jul 25 05:59:57.187910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-DeleteServersTestJSON-545890828-project Jul 25 05:59:57.187910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 05:59:57.187910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:57.187910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '57462ad3-d5fc-4dee-9087-afc18c4f0305'} Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:59:57.189195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. Jul 25 05:59:57.190373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 05:59:57.191463 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-52ffcc37-1d70-4414-8733-005ac4b264a6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] Returning 404 to user: Instance 57462ad3-d5fc-4dee-9087-afc18c4f0305 could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:59:57.191463 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-52ffcc37-1d70-4414-8733-005ac4b264a6 tempest-DeleteServersTestJSON-545890828 tempest-DeleteServersTestJSON-545890828-project] 10.222.0.17 "GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305" status: 404 len: 111 microversion: 2.1 time: 0.031702 Jul 25 05:59:57.191463 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 105/217] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:57 2022] GET /compute/v2.1/servers/57462ad3-d5fc-4dee-9087-afc18c4f0305 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:59:57.521723 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-83d9f7df-eead-409e-8a7a-b529949c7280 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:57.522349 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-83d9f7df-eead-409e-8a7a-b529949c7280 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:57.528328 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-83d9f7df-eead-409e-8a7a-b529949c7280 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:57.528765 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-83d9f7df-eead-409e-8a7a-b529949c7280 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:57.529518 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-83d9f7df-eead-409e-8a7a-b529949c7280 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:57.529948 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-83d9f7df-eead-409e-8a7a-b529949c7280 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:57.814326 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-83d9f7df-eead-409e-8a7a-b529949c7280 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:57.831501 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-83d9f7df-eead-409e-8a7a-b529949c7280 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.313546 Jul 25 05:59:57.833111 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 113/218] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:57 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:58.849838 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-69d91e12-f21f-4865-918c-9caadf3214a7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:58.850448 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-69d91e12-f21f-4865-918c-9caadf3214a7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:58.857088 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-69d91e12-f21f-4865-918c-9caadf3214a7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:58.857524 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-69d91e12-f21f-4865-918c-9caadf3214a7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:58.858285 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-69d91e12-f21f-4865-918c-9caadf3214a7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:58.858732 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-69d91e12-f21f-4865-918c-9caadf3214a7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:58.863339 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:59.067969 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-69d91e12-f21f-4865-918c-9caadf3214a7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:59.067969 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-69d91e12-f21f-4865-918c-9caadf3214a7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.184188 Jul 25 05:59:59.067969 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 106/219] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:58 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:00.048235 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2d4ec238-9b39-4921-8434-d4070c8d218f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:00.054500 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2d4ec238-9b39-4921-8434-d4070c8d218f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:00.055950 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2d4ec238-9b39-4921-8434-d4070c8d218f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:00.056444 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2d4ec238-9b39-4921-8434-d4070c8d218f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:00.057227 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2d4ec238-9b39-4921-8434-d4070c8d218f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:00.057688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2d4ec238-9b39-4921-8434-d4070c8d218f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:00.279855 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2d4ec238-9b39-4921-8434-d4070c8d218f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:00.294824 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2d4ec238-9b39-4921-8434-d4070c8d218f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.250339 Jul 25 06:00:00.295415 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 114/220] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:00 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:01.312367 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-15c535ba-174f-49b3-8e3f-4f35de852020 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:01.321781 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-15c535ba-174f-49b3-8e3f-4f35de852020 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:01.321781 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-15c535ba-174f-49b3-8e3f-4f35de852020 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:01.323905 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-15c535ba-174f-49b3-8e3f-4f35de852020 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:01.323905 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-15c535ba-174f-49b3-8e3f-4f35de852020 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:01.323905 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-15c535ba-174f-49b3-8e3f-4f35de852020 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:01.560529 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-15c535ba-174f-49b3-8e3f-4f35de852020 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:01.569186 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-15c535ba-174f-49b3-8e3f-4f35de852020 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.260785 Jul 25 06:00:01.569777 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 107/221] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:01 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:02.586945 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7777214f-3970-4775-9419-edcf7095fbd9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:02.587567 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7777214f-3970-4775-9419-edcf7095fbd9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:02.590203 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=71 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:02.595059 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7777214f-3970-4775-9419-edcf7095fbd9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:02.595947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7777214f-3970-4775-9419-edcf7095fbd9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:02.596264 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7777214f-3970-4775-9419-edcf7095fbd9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:02.596780 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7777214f-3970-4775-9419-edcf7095fbd9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:02.729396 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7777214f-3970-4775-9419-edcf7095fbd9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:02.737598 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-7777214f-3970-4775-9419-edcf7095fbd9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.154593 Jul 25 06:00:02.738175 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 115/222] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:02 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:03.755139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a97df647-f666-41b4-9396-476f27f091a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:03.755758 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a97df647-f666-41b4-9396-476f27f091a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:03.762808 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a97df647-f666-41b4-9396-476f27f091a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:03.763172 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a97df647-f666-41b4-9396-476f27f091a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:03.763933 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a97df647-f666-41b4-9396-476f27f091a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:03.764364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a97df647-f666-41b4-9396-476f27f091a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:03.903218 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-a97df647-f666-41b4-9396-476f27f091a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:03.913620 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a97df647-f666-41b4-9396-476f27f091a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.163248 Jul 25 06:00:03.914200 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 108/223] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:03 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:04.935167 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-bfc0853d-c2c8-40eb-b261-4a697fce8301 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:04.935785 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-bfc0853d-c2c8-40eb-b261-4a697fce8301 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:04.942840 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bfc0853d-c2c8-40eb-b261-4a697fce8301 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:04.943291 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bfc0853d-c2c8-40eb-b261-4a697fce8301 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:04.944051 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bfc0853d-c2c8-40eb-b261-4a697fce8301 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:04.944488 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bfc0853d-c2c8-40eb-b261-4a697fce8301 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:05.066612 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-bfc0853d-c2c8-40eb-b261-4a697fce8301 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:05.070012 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=100 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:05.074355 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-bfc0853d-c2c8-40eb-b261-4a697fce8301 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.143072 Jul 25 06:00:05.074940 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 116/224] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:04 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:06.091760 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3d43d845-d601-4d19-96af-c698531a0295 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:06.092404 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3d43d845-d601-4d19-96af-c698531a0295 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:06.094906 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:06.099533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3d43d845-d601-4d19-96af-c698531a0295 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:06.099976 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3d43d845-d601-4d19-96af-c698531a0295 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:06.101752 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3d43d845-d601-4d19-96af-c698531a0295 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:06.101752 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3d43d845-d601-4d19-96af-c698531a0295 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:06.226336 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3d43d845-d601-4d19-96af-c698531a0295 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:06.234271 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3d43d845-d601-4d19-96af-c698531a0295 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.146349 Jul 25 06:00:06.235023 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 109/225] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:06 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:07.251154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a0b48a1f-aacd-4dab-8c43-959714236f5a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:07.251765 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a0b48a1f-aacd-4dab-8c43-959714236f5a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:07.259253 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a0b48a1f-aacd-4dab-8c43-959714236f5a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:07.259707 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a0b48a1f-aacd-4dab-8c43-959714236f5a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:07.260477 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a0b48a1f-aacd-4dab-8c43-959714236f5a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:07.260915 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a0b48a1f-aacd-4dab-8c43-959714236f5a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:07.403301 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a0b48a1f-aacd-4dab-8c43-959714236f5a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:07.407906 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a0b48a1f-aacd-4dab-8c43-959714236f5a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.160619 Jul 25 06:00:07.408477 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 117/226] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:07 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:08.424896 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e6168309-a730-403d-8466-6fcc0cbba48f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:08.425503 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e6168309-a730-403d-8466-6fcc0cbba48f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:08.431558 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e6168309-a730-403d-8466-6fcc0cbba48f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:08.431996 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e6168309-a730-403d-8466-6fcc0cbba48f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:08.432782 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e6168309-a730-403d-8466-6fcc0cbba48f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:08.433208 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e6168309-a730-403d-8466-6fcc0cbba48f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:08.562110 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e6168309-a730-403d-8466-6fcc0cbba48f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:08.569486 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e6168309-a730-403d-8466-6fcc0cbba48f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.148422 Jul 25 06:00:08.570053 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 110/227] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:08 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:09.585083 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9c64735e-fc49-4209-a8ed-3547cccc121b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:09.585697 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-9c64735e-fc49-4209-a8ed-3547cccc121b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:09.591887 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9c64735e-fc49-4209-a8ed-3547cccc121b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:09.592331 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9c64735e-fc49-4209-a8ed-3547cccc121b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:09.593111 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9c64735e-fc49-4209-a8ed-3547cccc121b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:09.593546 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9c64735e-fc49-4209-a8ed-3547cccc121b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:09.723366 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9c64735e-fc49-4209-a8ed-3547cccc121b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:09.730711 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9c64735e-fc49-4209-a8ed-3547cccc121b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.149552 Jul 25 06:00:09.731266 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 118/228] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:09 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:10.747827 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-69199d12-cd6d-4eb3-b4a9-8ad885d14a17 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:10.748435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-69199d12-cd6d-4eb3-b4a9-8ad885d14a17 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:10.755112 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-69199d12-cd6d-4eb3-b4a9-8ad885d14a17 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:10.755561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-69199d12-cd6d-4eb3-b4a9-8ad885d14a17 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:10.756311 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-69199d12-cd6d-4eb3-b4a9-8ad885d14a17 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:10.756743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-69199d12-cd6d-4eb3-b4a9-8ad885d14a17 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:10.880959 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-69199d12-cd6d-4eb3-b4a9-8ad885d14a17 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:10.888380 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-69199d12-cd6d-4eb3-b4a9-8ad885d14a17 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.144349 Jul 25 06:00:10.888944 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 111/229] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:10 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:11.904989 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-50e960c8-f7f3-465b-adc6-8d3e6bbc1cc5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:11.905630 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-50e960c8-f7f3-465b-adc6-8d3e6bbc1cc5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:11.913252 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-50e960c8-f7f3-465b-adc6-8d3e6bbc1cc5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:11.913694 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-50e960c8-f7f3-465b-adc6-8d3e6bbc1cc5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:11.914457 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-50e960c8-f7f3-465b-adc6-8d3e6bbc1cc5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:11.914910 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-50e960c8-f7f3-465b-adc6-8d3e6bbc1cc5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:12.045199 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-50e960c8-f7f3-465b-adc6-8d3e6bbc1cc5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:12.052569 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-50e960c8-f7f3-465b-adc6-8d3e6bbc1cc5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.151412 Jul 25 06:00:12.053122 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 119/230] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:11 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:13.070053 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-890f5fbe-13d9-4224-8461-5f1fc575729a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:13.071270 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-890f5fbe-13d9-4224-8461-5f1fc575729a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:13.077353 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-890f5fbe-13d9-4224-8461-5f1fc575729a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:13.077818 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-890f5fbe-13d9-4224-8461-5f1fc575729a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:13.078766 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-890f5fbe-13d9-4224-8461-5f1fc575729a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:13.079358 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-890f5fbe-13d9-4224-8461-5f1fc575729a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:13.264913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-890f5fbe-13d9-4224-8461-5f1fc575729a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:13.272430 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-890f5fbe-13d9-4224-8461-5f1fc575729a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.206600 Jul 25 06:00:13.273224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 112/231] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:13 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:14.290091 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d3e6e52c-7008-4d6f-b611-5f88277a09a3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:14.290735 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d3e6e52c-7008-4d6f-b611-5f88277a09a3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:14.297626 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d3e6e52c-7008-4d6f-b611-5f88277a09a3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:14.298281 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d3e6e52c-7008-4d6f-b611-5f88277a09a3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:14.300006 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d3e6e52c-7008-4d6f-b611-5f88277a09a3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:14.300890 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d3e6e52c-7008-4d6f-b611-5f88277a09a3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:14.478446 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d3e6e52c-7008-4d6f-b611-5f88277a09a3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:14.487603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d3e6e52c-7008-4d6f-b611-5f88277a09a3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.201074 Jul 25 06:00:14.488364 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 120/232] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:14 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:15.504847 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-180c2f85-bcbf-47b4-8001-88ff5c7f7378 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:15.506222 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-180c2f85-bcbf-47b4-8001-88ff5c7f7378 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:15.512533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-180c2f85-bcbf-47b4-8001-88ff5c7f7378 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:15.515348 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-180c2f85-bcbf-47b4-8001-88ff5c7f7378 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:15.515348 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-180c2f85-bcbf-47b4-8001-88ff5c7f7378 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:15.515348 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-180c2f85-bcbf-47b4-8001-88ff5c7f7378 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:15.659565 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-180c2f85-bcbf-47b4-8001-88ff5c7f7378 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:15.668009 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-180c2f85-bcbf-47b4-8001-88ff5c7f7378 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.167548 Jul 25 06:00:15.668585 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 113/233] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:15 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:16.687861 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6be8027e-9e78-4552-b8ad-759c14d503a3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:16.688488 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6be8027e-9e78-4552-b8ad-759c14d503a3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:16.694989 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6be8027e-9e78-4552-b8ad-759c14d503a3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:16.704561 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6be8027e-9e78-4552-b8ad-759c14d503a3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:16.704561 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6be8027e-9e78-4552-b8ad-759c14d503a3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:16.704561 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6be8027e-9e78-4552-b8ad-759c14d503a3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:16.828338 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6be8027e-9e78-4552-b8ad-759c14d503a3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:16.836458 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6be8027e-9e78-4552-b8ad-759c14d503a3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.152601 Jul 25 06:00:16.837034 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 121/234] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:16 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:17.853535 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2695b477-2d53-48a7-a928-d2e42bcad31e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:17.854143 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2695b477-2d53-48a7-a928-d2e42bcad31e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:17.860168 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2695b477-2d53-48a7-a928-d2e42bcad31e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:17.860610 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2695b477-2d53-48a7-a928-d2e42bcad31e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:17.861353 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2695b477-2d53-48a7-a928-d2e42bcad31e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:17.861781 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2695b477-2d53-48a7-a928-d2e42bcad31e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:17.993118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2695b477-2d53-48a7-a928-d2e42bcad31e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:18.000490 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2695b477-2d53-48a7-a928-d2e42bcad31e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.150829 Jul 25 06:00:18.001057 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 114/235] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:17 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:19.017751 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-48263c3b-e052-427c-a3d1-30f1d0dc22af tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:19.018435 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-48263c3b-e052-427c-a3d1-30f1d0dc22af tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:19.025263 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-48263c3b-e052-427c-a3d1-30f1d0dc22af tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:19.025705 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-48263c3b-e052-427c-a3d1-30f1d0dc22af tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:19.026451 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-48263c3b-e052-427c-a3d1-30f1d0dc22af tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:19.026901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-48263c3b-e052-427c-a3d1-30f1d0dc22af tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:19.160339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-48263c3b-e052-427c-a3d1-30f1d0dc22af tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:19.167816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-48263c3b-e052-427c-a3d1-30f1d0dc22af tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.154366 Jul 25 06:00:19.168373 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 122/236] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:19 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:20.185057 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6b904638-8895-46c7-9862-34df761e3c71 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:20.185679 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-6b904638-8895-46c7-9862-34df761e3c71 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:20.191914 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6b904638-8895-46c7-9862-34df761e3c71 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:20.192354 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6b904638-8895-46c7-9862-34df761e3c71 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:20.193106 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6b904638-8895-46c7-9862-34df761e3c71 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:20.193531 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6b904638-8895-46c7-9862-34df761e3c71 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:20.319341 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-6b904638-8895-46c7-9862-34df761e3c71 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:20.326658 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-6b904638-8895-46c7-9862-34df761e3c71 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.145354 Jul 25 06:00:20.327215 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 115/237] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:20 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:21.345619 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-bae2b13c-884c-407a-90de-5e02566f2b19 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:21.345619 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-bae2b13c-884c-407a-90de-5e02566f2b19 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:21.351834 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bae2b13c-884c-407a-90de-5e02566f2b19 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:21.352292 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bae2b13c-884c-407a-90de-5e02566f2b19 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:21.353061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bae2b13c-884c-407a-90de-5e02566f2b19 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:21.353496 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bae2b13c-884c-407a-90de-5e02566f2b19 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:21.495100 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-bae2b13c-884c-407a-90de-5e02566f2b19 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:21.503938 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-bae2b13c-884c-407a-90de-5e02566f2b19 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1522 microversion: 2.1 time: 0.163768 Jul 25 06:00:21.504734 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 123/238] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:21 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:22.526691 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-84ff8cda-5ea9-4992-8c3e-9d646d9806b3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:22.527313 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-84ff8cda-5ea9-4992-8c3e-9d646d9806b3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:22.533255 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-84ff8cda-5ea9-4992-8c3e-9d646d9806b3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:22.535024 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-84ff8cda-5ea9-4992-8c3e-9d646d9806b3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:22.535024 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-84ff8cda-5ea9-4992-8c3e-9d646d9806b3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:22.535024 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-84ff8cda-5ea9-4992-8c3e-9d646d9806b3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:22.744577 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-84ff8cda-5ea9-4992-8c3e-9d646d9806b3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:22.752290 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-84ff8cda-5ea9-4992-8c3e-9d646d9806b3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1502 microversion: 2.1 time: 0.229538 Jul 25 06:00:22.752867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 116/239] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:22 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1502 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:22.769385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-dca9cbd4-860c-4751-b9bf-5dd9d277c09a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:22.769385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-dca9cbd4-860c-4751-b9bf-5dd9d277c09a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:22.776001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dca9cbd4-860c-4751-b9bf-5dd9d277c09a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:22.776390 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dca9cbd4-860c-4751-b9bf-5dd9d277c09a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:22.777160 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dca9cbd4-860c-4751-b9bf-5dd9d277c09a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:22.777600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dca9cbd4-860c-4751-b9bf-5dd9d277c09a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:22.964272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-dca9cbd4-860c-4751-b9bf-5dd9d277c09a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:22.974518 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-dca9cbd4-860c-4751-b9bf-5dd9d277c09a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.209961 Jul 25 06:00:22.979378 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 124/240] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:22 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1517 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:24.760037 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0b38522d-cf82-4d70-920f-37d41ec802d7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:24.761620 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0b38522d-cf82-4d70-920f-37d41ec802d7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:24.767551 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0b38522d-cf82-4d70-920f-37d41ec802d7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:24.767991 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0b38522d-cf82-4d70-920f-37d41ec802d7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:24.768778 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0b38522d-cf82-4d70-920f-37d41ec802d7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:24.769376 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0b38522d-cf82-4d70-920f-37d41ec802d7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:24.795282 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-0b38522d-cf82-4d70-920f-37d41ec802d7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lazy-loading 'flavor' on Instance uuid 0848c502-1383-407a-94d1-b92892dff9e4 {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:00:25.113770 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0b38522d-cf82-4d70-920f-37d41ec802d7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "POST /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4/action" status: 200 len: 32 microversion: 2.1 time: 0.357543 Jul 25 06:00:25.115424 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 117/241] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 06:00:24 2022] POST /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4/action => generated 32 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 06:00:25.125368 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d5c4a044-11fe-4b7d-8b10-951965848fc3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:25.126757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d5c4a044-11fe-4b7d-8b10-951965848fc3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:25.135714 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d5c4a044-11fe-4b7d-8b10-951965848fc3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:25.142357 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d5c4a044-11fe-4b7d-8b10-951965848fc3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:25.142357 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d5c4a044-11fe-4b7d-8b10-951965848fc3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:25.142357 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d5c4a044-11fe-4b7d-8b10-951965848fc3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:25.283539 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d5c4a044-11fe-4b7d-8b10-951965848fc3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:25.291749 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d5c4a044-11fe-4b7d-8b10-951965848fc3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.171151 Jul 25 06:00:25.292315 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 125/242] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:25 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:25.844100 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-99fe3e38-e157-454b-94d4-14808fbeee55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1851715921", "imageRef": "bfffd6ef-7f99-4a99-90f3-027fe9c89821", "flavorRef": "452", "networks": [{"uuid": "52152d6b-07f7-45ec-8d46-9e0aae61f6a5"}]}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:25.899009 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.network.neutron [None req-99fe3e38-e157-454b-94d4-14808fbeee55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] validate_networks() for [('52152d6b-07f7-45ec-8d46-9e0aae61f6a5', None, None, None, None, None)] {{(pid=130162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:00:26.310520 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a2eb3b7e-33bf-4f42-a6e4-e85848a48fc3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:26.311139 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a2eb3b7e-33bf-4f42-a6e4-e85848a48fc3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:26.317701 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a2eb3b7e-33bf-4f42-a6e4-e85848a48fc3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:26.318178 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a2eb3b7e-33bf-4f42-a6e4-e85848a48fc3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:26.319149 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a2eb3b7e-33bf-4f42-a6e4-e85848a48fc3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:26.319590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a2eb3b7e-33bf-4f42-a6e4-e85848a48fc3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:26.383661 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-99fe3e38-e157-454b-94d4-14808fbeee55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Flavor limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:00:26.384026 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-99fe3e38-e157-454b-94d4-14808fbeee55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Image limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:00:26.384568 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-99fe3e38-e157-454b-94d4-14808fbeee55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Flavor pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:00:26.385043 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-99fe3e38-e157-454b-94d4-14808fbeee55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Image pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:00:26.385527 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-99fe3e38-e157-454b-94d4-14808fbeee55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:00:26.398701 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-99fe3e38-e157-454b-94d4-14808fbeee55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:26.398701 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-99fe3e38-e157-454b-94d4-14808fbeee55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:26.399019 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-99fe3e38-e157-454b-94d4-14808fbeee55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:26.399597 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-99fe3e38-e157-454b-94d4-14808fbeee55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:26.425979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-99fe3e38-e157-454b-94d4-14808fbeee55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Getting quotas for project d9f37a52ba6146e5b1cccfdba0c60a18. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:00:26.431305 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-99fe3e38-e157-454b-94d4-14808fbeee55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Getting quotas for user 99feeb6cf0fa46b4aabecefcdf56deff and project d9f37a52ba6146e5b1cccfdba0c60a18. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:00:26.451291 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-99fe3e38-e157-454b-94d4-14808fbeee55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Going to run 1 instances... {{(pid=130162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:00:26.453963 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-99fe3e38-e157-454b-94d4-14808fbeee55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfffd6ef-7f99-4a99-90f3-027fe9c89821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:00:26.497372 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a2eb3b7e-33bf-4f42-a6e4-e85848a48fc3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:26.504799 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a2eb3b7e-33bf-4f42-a6e4-e85848a48fc3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.199448 Jul 25 06:00:26.507419 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 126/243] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:26 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:26.687628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-99fe3e38-e157-454b-94d4-14808fbeee55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848344 Jul 25 06:00:26.688275 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 118/244] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 06:00:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:00:26.701019 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b93ad914-ce6c-4d68-a51a-f69be3ee820c tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:26.703011 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b93ad914-ce6c-4d68-a51a-f69be3ee820c tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:26.799313 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b93ad914-ce6c-4d68-a51a-f69be3ee820c tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:26.807304 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b93ad914-ce6c-4d68-a51a-f69be3ee820c tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1219 microversion: 2.1 time: 0.110142 Jul 25 06:00:26.808397 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 127/245] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:26 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:27.521899 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e7134688-b446-4b1a-922c-5f262dfdaeee tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:27.522543 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e7134688-b446-4b1a-922c-5f262dfdaeee tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:27.529253 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e7134688-b446-4b1a-922c-5f262dfdaeee tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:27.529689 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e7134688-b446-4b1a-922c-5f262dfdaeee tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:27.530606 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e7134688-b446-4b1a-922c-5f262dfdaeee tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:27.530908 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e7134688-b446-4b1a-922c-5f262dfdaeee tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:27.694162 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e7134688-b446-4b1a-922c-5f262dfdaeee tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:27.701620 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e7134688-b446-4b1a-922c-5f262dfdaeee tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.183623 Jul 25 06:00:27.709081 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 119/246] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:27 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:27.823982 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-0e9dfc89-48b3-4654-800b-230bbc8788f7 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:27.824583 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-0e9dfc89-48b3-4654-800b-230bbc8788f7 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:27.831009 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0e9dfc89-48b3-4654-800b-230bbc8788f7 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:27.831458 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0e9dfc89-48b3-4654-800b-230bbc8788f7 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:27.832218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0e9dfc89-48b3-4654-800b-230bbc8788f7 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:27.832648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0e9dfc89-48b3-4654-800b-230bbc8788f7 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:27.932058 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-0e9dfc89-48b3-4654-800b-230bbc8788f7 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:27.939809 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-0e9dfc89-48b3-4654-800b-230bbc8788f7 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1223 microversion: 2.1 time: 0.119603 Jul 25 06:00:27.940380 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 128/247] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:27 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1223 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:28.719791 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3b324704-0790-4ad2-8edc-b4ff9a018462 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:28.720405 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3b324704-0790-4ad2-8edc-b4ff9a018462 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:28.727103 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3b324704-0790-4ad2-8edc-b4ff9a018462 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:28.728168 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3b324704-0790-4ad2-8edc-b4ff9a018462 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:28.728482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3b324704-0790-4ad2-8edc-b4ff9a018462 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:28.728920 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3b324704-0790-4ad2-8edc-b4ff9a018462 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:28.876561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3b324704-0790-4ad2-8edc-b4ff9a018462 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:28.889315 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3b324704-0790-4ad2-8edc-b4ff9a018462 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.170262 Jul 25 06:00:28.889315 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 120/248] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:28 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:28.962038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b66dd116-77cc-4b54-8216-4762c6eecb19 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:28.964296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b66dd116-77cc-4b54-8216-4762c6eecb19 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:28.980491 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b66dd116-77cc-4b54-8216-4762c6eecb19 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:28.984244 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b66dd116-77cc-4b54-8216-4762c6eecb19 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:28.986450 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b66dd116-77cc-4b54-8216-4762c6eecb19 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:28.988275 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b66dd116-77cc-4b54-8216-4762c6eecb19 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:29.079084 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b66dd116-77cc-4b54-8216-4762c6eecb19 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:29.088310 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b66dd116-77cc-4b54-8216-4762c6eecb19 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1279 microversion: 2.1 time: 0.134640 Jul 25 06:00:29.089366 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 129/249] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:28 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1279 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:29.904362 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a8b22ec2-1679-49a5-8544-a4982dc34b65 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:29.905622 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a8b22ec2-1679-49a5-8544-a4982dc34b65 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:29.913616 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a8b22ec2-1679-49a5-8544-a4982dc34b65 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:29.914069 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a8b22ec2-1679-49a5-8544-a4982dc34b65 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:29.914876 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a8b22ec2-1679-49a5-8544-a4982dc34b65 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:29.915307 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a8b22ec2-1679-49a5-8544-a4982dc34b65 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:29.933974 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:30.045861 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-a8b22ec2-1679-49a5-8544-a4982dc34b65 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:30.053263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a8b22ec2-1679-49a5-8544-a4982dc34b65 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.152775 Jul 25 06:00:30.053826 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 121/250] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:29 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:30.105001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-aa4a1b48-b504-4178-97e0-a200c9610071 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:30.106796 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-aa4a1b48-b504-4178-97e0-a200c9610071 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:30.114590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aa4a1b48-b504-4178-97e0-a200c9610071 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:30.115038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aa4a1b48-b504-4178-97e0-a200c9610071 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:30.115905 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aa4a1b48-b504-4178-97e0-a200c9610071 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:30.116556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aa4a1b48-b504-4178-97e0-a200c9610071 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:30.262588 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-aa4a1b48-b504-4178-97e0-a200c9610071 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:30.272686 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-aa4a1b48-b504-4178-97e0-a200c9610071 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1319 microversion: 2.1 time: 0.170816 Jul 25 06:00:30.274056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 130/251] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:30 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:30.889350 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0dd19c92-32d7-47b2-8d1c-785e40732dab tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2064408111", "imageRef": "bfffd6ef-7f99-4a99-90f3-027fe9c89821", "flavorRef": "452", "networks": [{"uuid": "63c40e02-062b-4ed7-ae6f-d46901ed1af6"}]}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:30.941828 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.network.neutron [None req-0dd19c92-32d7-47b2-8d1c-785e40732dab tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] validate_networks() for [('63c40e02-062b-4ed7-ae6f-d46901ed1af6', None, None, None, None, None)] {{(pid=130162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:00:31.075493 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8f3fa844-c678-4663-9da5-e09de7de3dd1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:31.076474 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8f3fa844-c678-4663-9da5-e09de7de3dd1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:31.087270 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8f3fa844-c678-4663-9da5-e09de7de3dd1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:31.088108 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8f3fa844-c678-4663-9da5-e09de7de3dd1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:31.088891 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8f3fa844-c678-4663-9da5-e09de7de3dd1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:31.089324 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8f3fa844-c678-4663-9da5-e09de7de3dd1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:31.308203 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8f3fa844-c678-4663-9da5-e09de7de3dd1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:31.316365 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8f3fa844-c678-4663-9da5-e09de7de3dd1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.250406 Jul 25 06:00:31.326893 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 131/252] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:31 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:31.331738 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-a9dcfe49-406f-4611-b6c1-12015c38daf2 req-04d0a3f8-78f9-4b83-a1f3-186b159d9288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e42471b-2518-4844-b7de-4e14e425fe2c", "tag": "de782dca-40d1-4006-9734-4aa7b02fecdd"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:31.340070 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-a9dcfe49-406f-4611-b6c1-12015c38daf2 req-04d0a3f8-78f9-4b83-a1f3-186b159d9288 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:31.340625 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-a9dcfe49-406f-4611-b6c1-12015c38daf2 req-04d0a3f8-78f9-4b83-a1f3-186b159d9288 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:31.351789 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-a9dcfe49-406f-4611-b6c1-12015c38daf2 req-04d0a3f8-78f9-4b83-a1f3-186b159d9288 service nova] Creating event network-changed:de782dca-40d1-4006-9734-4aa7b02fecdd for instance 7e42471b-2518-4844-b7de-4e14e425fe2c on hv-cinder-85083 Jul 25 06:00:31.356596 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-a9dcfe49-406f-4611-b6c1-12015c38daf2 req-04d0a3f8-78f9-4b83-a1f3-186b159d9288 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028607 Jul 25 06:00:31.357182 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 132/253] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:31.362032 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-94b08f85-0bef-42c6-a7b0-9470c787a850 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:31.362750 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-94b08f85-0bef-42c6-a7b0-9470c787a850 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:31.369370 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-94b08f85-0bef-42c6-a7b0-9470c787a850 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:31.369817 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-94b08f85-0bef-42c6-a7b0-9470c787a850 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:31.370598 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-94b08f85-0bef-42c6-a7b0-9470c787a850 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:31.371038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-94b08f85-0bef-42c6-a7b0-9470c787a850 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:31.512849 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-94b08f85-0bef-42c6-a7b0-9470c787a850 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:31.519881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-0dd19c92-32d7-47b2-8d1c-785e40732dab tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Flavor limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:00:31.520394 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-94b08f85-0bef-42c6-a7b0-9470c787a850 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1319 microversion: 2.1 time: 0.162089 Jul 25 06:00:31.520780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-0dd19c92-32d7-47b2-8d1c-785e40732dab tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Image limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:00:31.522806 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 133/254] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:31 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:31.522913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-0dd19c92-32d7-47b2-8d1c-785e40732dab tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Flavor pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:00:31.522913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-0dd19c92-32d7-47b2-8d1c-785e40732dab tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Image pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:00:31.522913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-0dd19c92-32d7-47b2-8d1c-785e40732dab tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:00:31.533111 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0dd19c92-32d7-47b2-8d1c-785e40732dab tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:31.533622 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0dd19c92-32d7-47b2-8d1c-785e40732dab tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:31.534514 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0dd19c92-32d7-47b2-8d1c-785e40732dab tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:31.535076 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0dd19c92-32d7-47b2-8d1c-785e40732dab tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:31.562825 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-0dd19c92-32d7-47b2-8d1c-785e40732dab tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Getting quotas for project 011cdb0f00b9444c812ac101bc5b43e3. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:00:31.562825 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-0dd19c92-32d7-47b2-8d1c-785e40732dab tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Getting quotas for user a01061da6fc0404facce47e669ec80af and project 011cdb0f00b9444c812ac101bc5b43e3. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:00:31.570506 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0dd19c92-32d7-47b2-8d1c-785e40732dab tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Going to run 1 instances... {{(pid=130162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:00:31.572766 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0dd19c92-32d7-47b2-8d1c-785e40732dab tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfffd6ef-7f99-4a99-90f3-027fe9c89821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:00:31.704411 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0dd19c92-32d7-47b2-8d1c-785e40732dab tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.818754 Jul 25 06:00:31.705066 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 122/255] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 06:00:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:00:31.715278 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ea105bdc-59c9-46cd-82a3-d57b01595279 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:31.715974 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ea105bdc-59c9-46cd-82a3-d57b01595279 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:31.775628 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ea105bdc-59c9-46cd-82a3-d57b01595279 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:31.792788 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ea105bdc-59c9-46cd-82a3-d57b01595279 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1214 microversion: 2.1 time: 0.079707 Jul 25 06:00:31.792788 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 134/256] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:31 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:32.333828 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1a5fb265-b2e9-4a59-8968-fc4d1e5ae1eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:32.335158 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1a5fb265-b2e9-4a59-8968-fc4d1e5ae1eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:32.341178 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1a5fb265-b2e9-4a59-8968-fc4d1e5ae1eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:32.341617 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1a5fb265-b2e9-4a59-8968-fc4d1e5ae1eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:32.342369 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1a5fb265-b2e9-4a59-8968-fc4d1e5ae1eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:32.342823 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1a5fb265-b2e9-4a59-8968-fc4d1e5ae1eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:32.474885 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1a5fb265-b2e9-4a59-8968-fc4d1e5ae1eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:32.482669 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1a5fb265-b2e9-4a59-8968-fc4d1e5ae1eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.152731 Jul 25 06:00:32.493296 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 123/257] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:32 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:32.537527 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4908e9c4-6b33-4de8-b307-0c99a8186593 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:32.538594 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4908e9c4-6b33-4de8-b307-0c99a8186593 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:32.545329 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4908e9c4-6b33-4de8-b307-0c99a8186593 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:32.545774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4908e9c4-6b33-4de8-b307-0c99a8186593 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:32.548248 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4908e9c4-6b33-4de8-b307-0c99a8186593 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:32.548248 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4908e9c4-6b33-4de8-b307-0c99a8186593 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:32.682356 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4908e9c4-6b33-4de8-b307-0c99a8186593 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:32.690124 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4908e9c4-6b33-4de8-b307-0c99a8186593 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1319 microversion: 2.1 time: 0.156986 Jul 25 06:00:32.694356 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 135/258] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:32 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:32.809017 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-82e76d46-2e43-4a9b-91b2-01445232590c tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:32.809811 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-82e76d46-2e43-4a9b-91b2-01445232590c tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:32.816053 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-82e76d46-2e43-4a9b-91b2-01445232590c tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:32.816485 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-82e76d46-2e43-4a9b-91b2-01445232590c tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:32.817235 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-82e76d46-2e43-4a9b-91b2-01445232590c tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:32.817869 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-82e76d46-2e43-4a9b-91b2-01445232590c tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:32.883335 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-82e76d46-2e43-4a9b-91b2-01445232590c tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:32.890842 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-82e76d46-2e43-4a9b-91b2-01445232590c tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1218 microversion: 2.1 time: 0.085693 Jul 25 06:00:32.891410 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 124/259] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:32 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:33.501419 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-83e691bc-57d4-41ec-bf3d-23a05ac87d8d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:33.502332 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-83e691bc-57d4-41ec-bf3d-23a05ac87d8d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:33.515957 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=46 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:33.515957 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-83e691bc-57d4-41ec-bf3d-23a05ac87d8d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:33.515957 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-83e691bc-57d4-41ec-bf3d-23a05ac87d8d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:33.533917 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-83e691bc-57d4-41ec-bf3d-23a05ac87d8d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:33.534812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-83e691bc-57d4-41ec-bf3d-23a05ac87d8d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:33.543919 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=100 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:33.710437 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ec051d51-837e-4e01-bcf3-190ba42b7a27 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:33.711834 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ec051d51-837e-4e01-bcf3-190ba42b7a27 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:33.718588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ec051d51-837e-4e01-bcf3-190ba42b7a27 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:33.719247 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ec051d51-837e-4e01-bcf3-190ba42b7a27 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:33.720204 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ec051d51-837e-4e01-bcf3-190ba42b7a27 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:33.720812 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ec051d51-837e-4e01-bcf3-190ba42b7a27 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:33.742859 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-83e691bc-57d4-41ec-bf3d-23a05ac87d8d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:33.751870 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-83e691bc-57d4-41ec-bf3d-23a05ac87d8d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.254682 Jul 25 06:00:33.752544 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 136/260] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:33 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:33.855856 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ec051d51-837e-4e01-bcf3-190ba42b7a27 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:33.863583 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ec051d51-837e-4e01-bcf3-190ba42b7a27 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1319 microversion: 2.1 time: 0.158333 Jul 25 06:00:33.873022 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 125/261] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:33 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:33.908282 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-06f7bd20-2d23-426d-abdb-6e43be38b162 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:33.909160 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-06f7bd20-2d23-426d-abdb-6e43be38b162 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:33.917023 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-06f7bd20-2d23-426d-abdb-6e43be38b162 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:33.917471 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-06f7bd20-2d23-426d-abdb-6e43be38b162 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:33.918333 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-06f7bd20-2d23-426d-abdb-6e43be38b162 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:33.918728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-06f7bd20-2d23-426d-abdb-6e43be38b162 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:33.982752 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-06f7bd20-2d23-426d-abdb-6e43be38b162 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:33.991253 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-06f7bd20-2d23-426d-abdb-6e43be38b162 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1266 microversion: 2.1 time: 0.086955 Jul 25 06:00:33.991824 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 137/262] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:33 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:34.706343 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d5194269-f1d9-493b-b423-aca658d9217c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:34.707073 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d5194269-f1d9-493b-b423-aca658d9217c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:34.717060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d5194269-f1d9-493b-b423-aca658d9217c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:34.721089 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d5194269-f1d9-493b-b423-aca658d9217c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:34.721089 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d5194269-f1d9-493b-b423-aca658d9217c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:34.721089 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d5194269-f1d9-493b-b423-aca658d9217c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:34.769873 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ff8416ab-520e-46d4-b534-75b987ea2982 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:34.770673 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ff8416ab-520e-46d4-b534-75b987ea2982 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:34.777377 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d5194269-f1d9-493b-b423-aca658d9217c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/ips" status: 200 len: 148 microversion: 2.1 time: 0.074985 Jul 25 06:00:34.778744 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 126/263] 10.222.0.17 () {58 vars in 1247 bytes} [Mon Jul 25 06:00:34 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/ips => generated 148 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:34.794704 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ff8416ab-520e-46d4-b534-75b987ea2982 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:34.794704 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ff8416ab-520e-46d4-b534-75b987ea2982 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:34.797308 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ff8416ab-520e-46d4-b534-75b987ea2982 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:34.797636 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ff8416ab-520e-46d4-b534-75b987ea2982 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:34.880810 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-40c46031-4c40-4873-8f09-4ac4f673aaf0 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:34.881958 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-40c46031-4c40-4873-8f09-4ac4f673aaf0 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:34.900177 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-40c46031-4c40-4873-8f09-4ac4f673aaf0 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:34.900741 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-40c46031-4c40-4873-8f09-4ac4f673aaf0 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:34.901627 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-40c46031-4c40-4873-8f09-4ac4f673aaf0 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:34.902130 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-40c46031-4c40-4873-8f09-4ac4f673aaf0 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:35.041833 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ff8416ab-520e-46d4-b534-75b987ea2982 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:35.049531 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ff8416ab-520e-46d4-b534-75b987ea2982 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.283520 Jul 25 06:00:35.050388 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 138/264] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:34 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:35.058299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-96f67220-7370-4758-a11d-1570107034e1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:35.061437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-96f67220-7370-4758-a11d-1570107034e1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:35.067937 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-96f67220-7370-4758-a11d-1570107034e1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:35.068577 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-96f67220-7370-4758-a11d-1570107034e1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:35.069522 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-96f67220-7370-4758-a11d-1570107034e1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:35.070103 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-96f67220-7370-4758-a11d-1570107034e1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:35.228473 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-40c46031-4c40-4873-8f09-4ac4f673aaf0 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:35.236099 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-40c46031-4c40-4873-8f09-4ac4f673aaf0 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1319 microversion: 2.1 time: 0.359587 Jul 25 06:00:35.241130 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-96f67220-7370-4758-a11d-1570107034e1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:35.248858 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 127/265] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:34 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:35.250389 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0e1fe323-15cd-42f0-8be9-c4ddf71ad24a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:35.251094 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0e1fe323-15cd-42f0-8be9-c4ddf71ad24a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:35.252645 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-96f67220-7370-4758-a11d-1570107034e1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1314 microversion: 2.1 time: 0.200928 Jul 25 06:00:35.253566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 139/266] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:35 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:35.259542 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0e1fe323-15cd-42f0-8be9-c4ddf71ad24a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:35.260167 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0e1fe323-15cd-42f0-8be9-c4ddf71ad24a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:35.260927 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0e1fe323-15cd-42f0-8be9-c4ddf71ad24a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:35.261356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0e1fe323-15cd-42f0-8be9-c4ddf71ad24a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:35.285128 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0e1fe323-15cd-42f0-8be9-c4ddf71ad24a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/ips" status: 200 len: 151 microversion: 2.20 time: 0.038503 Jul 25 06:00:35.285720 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 128/267] 10.222.0.17 () {60 vars in 1288 bytes} [Mon Jul 25 06:00:35 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 06:00:36.067453 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-1f6bcf57-b3b6-465f-af3e-b42907a8dc79 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:36.068066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-1f6bcf57-b3b6-465f-af3e-b42907a8dc79 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:36.074563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1f6bcf57-b3b6-465f-af3e-b42907a8dc79 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:36.075195 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1f6bcf57-b3b6-465f-af3e-b42907a8dc79 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:36.075955 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1f6bcf57-b3b6-465f-af3e-b42907a8dc79 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:36.076387 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1f6bcf57-b3b6-465f-af3e-b42907a8dc79 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:36.171991 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-4da72712-4a38-4e84-9c89-b060face8019 req-ef9493db-a8b8-40bb-af6d-f2caa7730558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f657de8-5b01-4b65-bb0a-db7a32bb204a", "tag": "775cd6db-de8a-45e9-b974-48b8a6124139"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:36.176467 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:36.181254 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-4da72712-4a38-4e84-9c89-b060face8019 req-ef9493db-a8b8-40bb-af6d-f2caa7730558 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:36.181688 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-4da72712-4a38-4e84-9c89-b060face8019 req-ef9493db-a8b8-40bb-af6d-f2caa7730558 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:36.192708 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-4da72712-4a38-4e84-9c89-b060face8019 req-ef9493db-a8b8-40bb-af6d-f2caa7730558 service nova] Creating event network-changed:775cd6db-de8a-45e9-b974-48b8a6124139 for instance 5f657de8-5b01-4b65-bb0a-db7a32bb204a on hv-cinder-85083 Jul 25 06:00:36.197960 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-4da72712-4a38-4e84-9c89-b060face8019 req-ef9493db-a8b8-40bb-af6d-f2caa7730558 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029764 Jul 25 06:00:36.198913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 129/268] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:00:36.227913 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-1f6bcf57-b3b6-465f-af3e-b42907a8dc79 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:36.242872 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-1f6bcf57-b3b6-465f-af3e-b42907a8dc79 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.178879 Jul 25 06:00:36.246951 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 140/269] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:36 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:36.262147 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-49ffd83f-c488-426c-b903-533d92bccc22 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:36.263047 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-49ffd83f-c488-426c-b903-533d92bccc22 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:36.269794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-49ffd83f-c488-426c-b903-533d92bccc22 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:36.270406 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-49ffd83f-c488-426c-b903-533d92bccc22 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:36.270917 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-83e3a845-8a2e-441e-a991-2830ef47c053 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:36.271369 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-49ffd83f-c488-426c-b903-533d92bccc22 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:36.271610 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-83e3a845-8a2e-441e-a991-2830ef47c053 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:36.271912 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-49ffd83f-c488-426c-b903-533d92bccc22 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:36.278492 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-83e3a845-8a2e-441e-a991-2830ef47c053 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:36.278983 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-83e3a845-8a2e-441e-a991-2830ef47c053 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:36.280122 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-83e3a845-8a2e-441e-a991-2830ef47c053 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:36.281226 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-83e3a845-8a2e-441e-a991-2830ef47c053 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:36.466091 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-83e3a845-8a2e-441e-a991-2830ef47c053 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:36.469963 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-49ffd83f-c488-426c-b903-533d92bccc22 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:36.481373 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-83e3a845-8a2e-441e-a991-2830ef47c053 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1314 microversion: 2.1 time: 0.214266 Jul 25 06:00:36.482043 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 141/270] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:36 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:36.484858 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-49ffd83f-c488-426c-b903-533d92bccc22 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1319 microversion: 2.1 time: 0.227379 Jul 25 06:00:36.485518 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 130/271] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:36 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:36.742911 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-5e0dbc3d-a13c-4d84-8a8a-892aba1f6229 req-9420b008-1a23-4999-9f9b-80f386c963c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e42471b-2518-4844-b7de-4e14e425fe2c", "name": "network-vif-plugged", "status": "completed", "tag": "de782dca-40d1-4006-9734-4aa7b02fecdd"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:36.756080 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-5e0dbc3d-a13c-4d84-8a8a-892aba1f6229 req-9420b008-1a23-4999-9f9b-80f386c963c7 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:36.756831 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-5e0dbc3d-a13c-4d84-8a8a-892aba1f6229 req-9420b008-1a23-4999-9f9b-80f386c963c7 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:36.786427 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-5e0dbc3d-a13c-4d84-8a8a-892aba1f6229 req-9420b008-1a23-4999-9f9b-80f386c963c7 service nova] Creating event network-vif-plugged:de782dca-40d1-4006-9734-4aa7b02fecdd for instance 7e42471b-2518-4844-b7de-4e14e425fe2c on hv-cinder-85083 Jul 25 06:00:36.805314 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-5e0dbc3d-a13c-4d84-8a8a-892aba1f6229 req-9420b008-1a23-4999-9f9b-80f386c963c7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066610 Jul 25 06:00:36.806247 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 142/272] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:36.829779 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f66ecde8-5a54-4e7b-9479-86ec95fdaad4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e1c5ae7-4d6f-4170-8bc3-d2e10017e9fd"}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:36.831625 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f66ecde8-5a54-4e7b-9479-86ec95fdaad4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:36.841322 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f66ecde8-5a54-4e7b-9479-86ec95fdaad4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:36.841963 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f66ecde8-5a54-4e7b-9479-86ec95fdaad4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:36.843485 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f66ecde8-5a54-4e7b-9479-86ec95fdaad4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:36.844279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f66ecde8-5a54-4e7b-9479-86ec95fdaad4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:37.263854 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-924ba167-71fd-4633-a123-e5d9b6a6d931 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:37.264718 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-924ba167-71fd-4633-a123-e5d9b6a6d931 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:37.270963 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-924ba167-71fd-4633-a123-e5d9b6a6d931 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:37.272141 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-924ba167-71fd-4633-a123-e5d9b6a6d931 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:37.273378 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-924ba167-71fd-4633-a123-e5d9b6a6d931 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:37.274004 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-924ba167-71fd-4633-a123-e5d9b6a6d931 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:37.424732 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-924ba167-71fd-4633-a123-e5d9b6a6d931 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:37.433355 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-924ba167-71fd-4633-a123-e5d9b6a6d931 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.174211 Jul 25 06:00:37.433929 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 143/273] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:37 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:37.499290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c0ea33b6-8216-44cf-971f-bbea4efbebfe tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:37.499996 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c0ea33b6-8216-44cf-971f-bbea4efbebfe tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:37.506622 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c0ea33b6-8216-44cf-971f-bbea4efbebfe tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:37.507073 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c0ea33b6-8216-44cf-971f-bbea4efbebfe tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:37.507835 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c0ea33b6-8216-44cf-971f-bbea4efbebfe tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:37.508264 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c0ea33b6-8216-44cf-971f-bbea4efbebfe tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:37.660668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-c0ea33b6-8216-44cf-971f-bbea4efbebfe tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:37.668738 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c0ea33b6-8216-44cf-971f-bbea4efbebfe tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1314 microversion: 2.1 time: 0.173867 Jul 25 06:00:37.669308 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 144/274] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:37 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:37.674180 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-bb770abf-a9d2-4cc9-a3b6-90d7cda1b4b4 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:37.675004 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-bb770abf-a9d2-4cc9-a3b6-90d7cda1b4b4 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:37.688983 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bb770abf-a9d2-4cc9-a3b6-90d7cda1b4b4 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:37.689450 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bb770abf-a9d2-4cc9-a3b6-90d7cda1b4b4 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:37.690233 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bb770abf-a9d2-4cc9-a3b6-90d7cda1b4b4 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:37.690694 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bb770abf-a9d2-4cc9-a3b6-90d7cda1b4b4 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:37.796558 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f66ecde8-5a54-4e7b-9479-86ec95fdaad4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "POST /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.981113 Jul 25 06:00:37.798998 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 131/275] 10.222.0.17 () {60 vars in 1322 bytes} [Mon Jul 25 06:00:36 2022] POST /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments => generated 194 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:37.847751 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-bb770abf-a9d2-4cc9-a3b6-90d7cda1b4b4 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:37.856920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-bb770abf-a9d2-4cc9-a3b6-90d7cda1b4b4 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1319 microversion: 2.1 time: 0.186609 Jul 25 06:00:37.857498 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 145/276] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:37 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:38.451248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-dfd675b2-7997-4174-b2c6-d5963b0195f5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:38.451938 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-dfd675b2-7997-4174-b2c6-d5963b0195f5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:38.460056 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dfd675b2-7997-4174-b2c6-d5963b0195f5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:38.460493 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dfd675b2-7997-4174-b2c6-d5963b0195f5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:38.461245 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dfd675b2-7997-4174-b2c6-d5963b0195f5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:38.461670 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dfd675b2-7997-4174-b2c6-d5963b0195f5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:38.471176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ae3dd10c-38dc-4bcb-9352-66b4592223f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:38.471734 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ae3dd10c-38dc-4bcb-9352-66b4592223f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:38.479094 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ae3dd10c-38dc-4bcb-9352-66b4592223f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:38.479542 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ae3dd10c-38dc-4bcb-9352-66b4592223f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:38.480390 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ae3dd10c-38dc-4bcb-9352-66b4592223f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:38.480988 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ae3dd10c-38dc-4bcb-9352-66b4592223f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:38.504314 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.objects.instance [None req-ae3dd10c-38dc-4bcb-9352-66b4592223f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lazy-loading 'flavor' on Instance uuid 348f256d-41e5-47d8-b165-cad6dfcd0be9 {{(pid=130163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:00:38.598169 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-dfd675b2-7997-4174-b2c6-d5963b0195f5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:38.608541 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-dfd675b2-7997-4174-b2c6-d5963b0195f5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.161579 Jul 25 06:00:38.609114 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 132/277] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:38 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:38.686961 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3331aa93-45bd-444f-8bfa-08fd32557dc5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:38.687582 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3331aa93-45bd-444f-8bfa-08fd32557dc5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:38.695705 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3331aa93-45bd-444f-8bfa-08fd32557dc5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:38.696245 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3331aa93-45bd-444f-8bfa-08fd32557dc5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:38.697010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3331aa93-45bd-444f-8bfa-08fd32557dc5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:38.697434 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3331aa93-45bd-444f-8bfa-08fd32557dc5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:38.863078 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3331aa93-45bd-444f-8bfa-08fd32557dc5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:38.872285 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3331aa93-45bd-444f-8bfa-08fd32557dc5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1314 microversion: 2.1 time: 0.189861 Jul 25 06:00:38.882149 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 133/278] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:38 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:38.895818 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d656b7e2-6b4d-476e-8eeb-0c56bcfdeb55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:38.896710 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d656b7e2-6b4d-476e-8eeb-0c56bcfdeb55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:38.909510 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d656b7e2-6b4d-476e-8eeb-0c56bcfdeb55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:38.913294 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d656b7e2-6b4d-476e-8eeb-0c56bcfdeb55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:38.917734 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d656b7e2-6b4d-476e-8eeb-0c56bcfdeb55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:38.918818 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d656b7e2-6b4d-476e-8eeb-0c56bcfdeb55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:39.107572 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d656b7e2-6b4d-476e-8eeb-0c56bcfdeb55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:39.123549 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d656b7e2-6b4d-476e-8eeb-0c56bcfdeb55 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1319 microversion: 2.1 time: 0.245988 Jul 25 06:00:39.125405 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 134/279] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:38 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:39.348496 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ae3dd10c-38dc-4bcb-9352-66b4592223f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "POST /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/action" status: 202 len: 0 microversion: 2.20 time: 0.878150 Jul 25 06:00:39.348496 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 146/280] 10.222.0.17 () {62 vars in 1318 bytes} [Mon Jul 25 06:00:38 2022] POST /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/action => generated 0 bytes in 880 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 06:00:39.356741 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-c79e46e7-4a1d-41c6-8af0-5dd07a335764 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:39.358001 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-c79e46e7-4a1d-41c6-8af0-5dd07a335764 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:39.367510 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c79e46e7-4a1d-41c6-8af0-5dd07a335764 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:39.368070 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c79e46e7-4a1d-41c6-8af0-5dd07a335764 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:39.369221 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c79e46e7-4a1d-41c6-8af0-5dd07a335764 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:39.369755 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c79e46e7-4a1d-41c6-8af0-5dd07a335764 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:39.535862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-c79e46e7-4a1d-41c6-8af0-5dd07a335764 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:39.544663 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-c79e46e7-4a1d-41c6-8af0-5dd07a335764 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:39.546163 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b36a2de3-02e0-453f-a090-b67b7e69ae7c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:39.546672 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-c79e46e7-4a1d-41c6-8af0-5dd07a335764 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:39.546779 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b36a2de3-02e0-453f-a090-b67b7e69ae7c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:39.547351 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-c79e46e7-4a1d-41c6-8af0-5dd07a335764 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1721 microversion: 2.20 time: 0.195792 Jul 25 06:00:39.547906 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 135/281] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:39 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:39.553825 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b36a2de3-02e0-453f-a090-b67b7e69ae7c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:39.554274 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b36a2de3-02e0-453f-a090-b67b7e69ae7c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:39.555052 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b36a2de3-02e0-453f-a090-b67b7e69ae7c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:39.555475 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b36a2de3-02e0-453f-a090-b67b7e69ae7c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:39.578329 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b36a2de3-02e0-453f-a090-b67b7e69ae7c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/ips" status: 200 len: 147 microversion: 2.1 time: 0.036840 Jul 25 06:00:39.578948 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 147/282] 10.222.0.17 () {58 vars in 1247 bytes} [Mon Jul 25 06:00:39 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:00:39.628620 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0bd99b1d-c364-4d96-87c6-97f486f0c365 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:39.629493 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0bd99b1d-c364-4d96-87c6-97f486f0c365 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:39.635923 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0bd99b1d-c364-4d96-87c6-97f486f0c365 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:39.636508 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0bd99b1d-c364-4d96-87c6-97f486f0c365 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:39.637590 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0bd99b1d-c364-4d96-87c6-97f486f0c365 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:39.638026 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0bd99b1d-c364-4d96-87c6-97f486f0c365 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:39.804402 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0bd99b1d-c364-4d96-87c6-97f486f0c365 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:39.814065 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0bd99b1d-c364-4d96-87c6-97f486f0c365 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.191187 Jul 25 06:00:39.814913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 136/283] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:39 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:39.896039 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-0b7a2bc3-a1bb-4331-b003-9e34f49bcad4 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:39.897588 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-0b7a2bc3-a1bb-4331-b003-9e34f49bcad4 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:39.912337 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0b7a2bc3-a1bb-4331-b003-9e34f49bcad4 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:39.917510 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0b7a2bc3-a1bb-4331-b003-9e34f49bcad4 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:39.917510 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0b7a2bc3-a1bb-4331-b003-9e34f49bcad4 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:39.917510 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0b7a2bc3-a1bb-4331-b003-9e34f49bcad4 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:40.140370 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-dd91d966-caac-4827-8d8e-cef07354fafc tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:40.140980 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-dd91d966-caac-4827-8d8e-cef07354fafc tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:40.147830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dd91d966-caac-4827-8d8e-cef07354fafc tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:40.148611 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dd91d966-caac-4827-8d8e-cef07354fafc tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:40.149370 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dd91d966-caac-4827-8d8e-cef07354fafc tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:40.149800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dd91d966-caac-4827-8d8e-cef07354fafc tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:40.150644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-0b7a2bc3-a1bb-4331-b003-9e34f49bcad4 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:40.161364 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-0b7a2bc3-a1bb-4331-b003-9e34f49bcad4 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1314 microversion: 2.1 time: 0.273916 Jul 25 06:00:40.165637 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 148/284] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:39 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:40.309173 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-dd91d966-caac-4827-8d8e-cef07354fafc tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:40.317013 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-dd91d966-caac-4827-8d8e-cef07354fafc tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1509 microversion: 2.1 time: 0.180448 Jul 25 06:00:40.317831 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 137/285] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:40 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:40.610976 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5d323752-29b7-429e-9bfe-b567f45d8bd1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:40.610976 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5d323752-29b7-429e-9bfe-b567f45d8bd1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:40.610976 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5d323752-29b7-429e-9bfe-b567f45d8bd1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:40.610976 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5d323752-29b7-429e-9bfe-b567f45d8bd1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:40.612476 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5d323752-29b7-429e-9bfe-b567f45d8bd1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:40.612476 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5d323752-29b7-429e-9bfe-b567f45d8bd1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:40.831621 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0257dadb-2325-4971-837d-53293f2aa386 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:40.832352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0257dadb-2325-4971-837d-53293f2aa386 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:40.843428 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0257dadb-2325-4971-837d-53293f2aa386 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:40.844126 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0257dadb-2325-4971-837d-53293f2aa386 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:40.846834 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0257dadb-2325-4971-837d-53293f2aa386 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:40.848134 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0257dadb-2325-4971-837d-53293f2aa386 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:40.866610 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5d323752-29b7-429e-9bfe-b567f45d8bd1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:40.878122 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5d323752-29b7-429e-9bfe-b567f45d8bd1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:40.879817 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5d323752-29b7-429e-9bfe-b567f45d8bd1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:40.883134 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5d323752-29b7-429e-9bfe-b567f45d8bd1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1721 microversion: 2.20 time: 0.321727 Jul 25 06:00:40.896568 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 149/286] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:40 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1721 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:41.180065 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-374ae672-2c88-43b8-a2d3-a0960990c0a4 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:41.180838 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-374ae672-2c88-43b8-a2d3-a0960990c0a4 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:41.187375 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-374ae672-2c88-43b8-a2d3-a0960990c0a4 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:41.188071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-374ae672-2c88-43b8-a2d3-a0960990c0a4 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:41.189071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-374ae672-2c88-43b8-a2d3-a0960990c0a4 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:41.189876 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-374ae672-2c88-43b8-a2d3-a0960990c0a4 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:41.206434 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0257dadb-2325-4971-837d-53293f2aa386 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:41.211061 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:41.215764 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0257dadb-2325-4971-837d-53293f2aa386 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.388157 Jul 25 06:00:41.216355 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 138/287] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:40 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:41.572711 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-374ae672-2c88-43b8-a2d3-a0960990c0a4 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:41.582723 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-374ae672-2c88-43b8-a2d3-a0960990c0a4 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1314 microversion: 2.1 time: 0.407378 Jul 25 06:00:41.583897 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 150/288] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:41 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:41.903018 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-16e09756-17e5-4b5c-87b6-9aa82c663b48 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:41.904307 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-16e09756-17e5-4b5c-87b6-9aa82c663b48 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:41.906155 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=4 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:41.907006 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=12 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:41.924227 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-16e09756-17e5-4b5c-87b6-9aa82c663b48 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:41.927214 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-16e09756-17e5-4b5c-87b6-9aa82c663b48 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:41.928215 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-16e09756-17e5-4b5c-87b6-9aa82c663b48 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:41.928703 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-16e09756-17e5-4b5c-87b6-9aa82c663b48 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:42.242195 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9a59774c-3104-4052-86ec-d2b129520dde tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:42.243925 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-9a59774c-3104-4052-86ec-d2b129520dde tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:42.246555 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=4 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:42.266623 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-16e09756-17e5-4b5c-87b6-9aa82c663b48 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:42.276195 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9a59774c-3104-4052-86ec-d2b129520dde tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:42.276985 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9a59774c-3104-4052-86ec-d2b129520dde tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:42.278824 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9a59774c-3104-4052-86ec-d2b129520dde tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:42.281382 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-16e09756-17e5-4b5c-87b6-9aa82c663b48 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:42.282420 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9a59774c-3104-4052-86ec-d2b129520dde tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:42.298679 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-16e09756-17e5-4b5c-87b6-9aa82c663b48 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:42.300835 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-16e09756-17e5-4b5c-87b6-9aa82c663b48 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1721 microversion: 2.20 time: 0.402345 Jul 25 06:00:42.301983 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 139/289] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:41 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1721 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:42.473831 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a2ea4eaf-6b2b-4a04-9e71-a4e12c5a9716 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Action: 'create', calling method: .version_select at 0x7f9d36b4a310>, body: {"keypair": {"name": "tempest-keypair-1091290031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvtj/GQT0GQEOVwk6h5IZorbcQtUDUHXhWiw1glKiAI9yGcWguf2tTxkfAL8FYAxMvrvnr5cn6JOraHNqAM37dbS57ZRuyhoTCpq3XZgY6cJ0zeMn/LDJjaKzRV8WhbmA=="}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:42.497095 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-a2ea4eaf-6b2b-4a04-9e71-a4e12c5a9716 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Getting quotas for project 488e87a8233e4e69a07cd8efba37cad7. Resources: {'key_pairs'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:00:42.503164 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-a2ea4eaf-6b2b-4a04-9e71-a4e12c5a9716 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Getting quotas for user 6dc49525e3394668b4f1610c4badc144 and project 488e87a8233e4e69a07cd8efba37cad7. Resources: {'key_pairs'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:00:42.518990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9a59774c-3104-4052-86ec-d2b129520dde tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:42.525178 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:42.539369 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9a59774c-3104-4052-86ec-d2b129520dde tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.308234 Jul 25 06:00:42.549096 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 151/290] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:42 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:42.600771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f2d6905c-453b-4b19-94fd-66d232323c54 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:42.601372 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f2d6905c-453b-4b19-94fd-66d232323c54 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:42.607807 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f2d6905c-453b-4b19-94fd-66d232323c54 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:42.608252 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f2d6905c-453b-4b19-94fd-66d232323c54 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:42.609125 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f2d6905c-453b-4b19-94fd-66d232323c54 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:42.609742 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f2d6905c-453b-4b19-94fd-66d232323c54 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:42.700573 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a2ea4eaf-6b2b-4a04-9e71-a4e12c5a9716 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.233068 Jul 25 06:00:42.702034 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 140/291] 10.222.0.17 () {60 vars in 1158 bytes} [Mon Jul 25 06:00:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:00:42.880593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f2d6905c-453b-4b19-94fd-66d232323c54 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:42.889822 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f2d6905c-453b-4b19-94fd-66d232323c54 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1314 microversion: 2.1 time: 0.293265 Jul 25 06:00:42.900893 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 152/292] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:42 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:42.978512 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1f2f58e5-9220-4487-9ad8-bbe530b8b8fc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc40c569-4115-4cb6-9fa4-d4bfb3619a76"}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:42.981004 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1f2f58e5-9220-4487-9ad8-bbe530b8b8fc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:42.987752 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1f2f58e5-9220-4487-9ad8-bbe530b8b8fc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:42.988525 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1f2f58e5-9220-4487-9ad8-bbe530b8b8fc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:42.989451 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1f2f58e5-9220-4487-9ad8-bbe530b8b8fc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:42.990323 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1f2f58e5-9220-4487-9ad8-bbe530b8b8fc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:43.081710 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-7a382206-2a8d-4601-ba70-bdf094ac053f req-9aebf1bd-613b-4a3d-8a59-22d4bc0c5ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f657de8-5b01-4b65-bb0a-db7a32bb204a", "name": "network-vif-plugged", "status": "completed", "tag": "775cd6db-de8a-45e9-b974-48b8a6124139"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:43.090255 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-7a382206-2a8d-4601-ba70-bdf094ac053f req-9aebf1bd-613b-4a3d-8a59-22d4bc0c5ab0 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:43.091071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-7a382206-2a8d-4601-ba70-bdf094ac053f req-9aebf1bd-613b-4a3d-8a59-22d4bc0c5ab0 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:43.116151 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-7a382206-2a8d-4601-ba70-bdf094ac053f req-9aebf1bd-613b-4a3d-8a59-22d4bc0c5ab0 service nova] Creating event network-vif-plugged:775cd6db-de8a-45e9-b974-48b8a6124139 for instance 5f657de8-5b01-4b65-bb0a-db7a32bb204a on hv-cinder-85083 Jul 25 06:00:43.121546 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-7a382206-2a8d-4601-ba70-bdf094ac053f req-9aebf1bd-613b-4a3d-8a59-22d4bc0c5ab0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044077 Jul 25 06:00:43.122336 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 153/293] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:00:43.339294 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b224c41e-a6e7-4884-861c-7fd7b9ab93bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:43.350817 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b224c41e-a6e7-4884-861c-7fd7b9ab93bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:43.359922 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b224c41e-a6e7-4884-861c-7fd7b9ab93bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:43.361045 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b224c41e-a6e7-4884-861c-7fd7b9ab93bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:43.361983 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b224c41e-a6e7-4884-861c-7fd7b9ab93bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:43.362521 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b224c41e-a6e7-4884-861c-7fd7b9ab93bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:43.592346 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b224c41e-a6e7-4884-861c-7fd7b9ab93bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:43.601056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b224c41e-a6e7-4884-861c-7fd7b9ab93bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:43.602639 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b224c41e-a6e7-4884-861c-7fd7b9ab93bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:43.603817 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b224c41e-a6e7-4884-861c-7fd7b9ab93bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1721 microversion: 2.20 time: 0.287089 Jul 25 06:00:43.611571 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 154/294] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:43 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:43.611571 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-77406850-4662-47e0-9134-dfc64407c997 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:43.611571 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-77406850-4662-47e0-9134-dfc64407c997 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:43.624957 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-77406850-4662-47e0-9134-dfc64407c997 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:43.625405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-77406850-4662-47e0-9134-dfc64407c997 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:43.626372 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-77406850-4662-47e0-9134-dfc64407c997 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:43.626836 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-77406850-4662-47e0-9134-dfc64407c997 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:43.831777 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-77406850-4662-47e0-9134-dfc64407c997 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:43.844352 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-77406850-4662-47e0-9134-dfc64407c997 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.238204 Jul 25 06:00:43.845359 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 155/295] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:43 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:43.883854 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1f2f58e5-9220-4487-9ad8-bbe530b8b8fc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "POST /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.909547 Jul 25 06:00:43.886137 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 141/296] 10.222.0.17 () {60 vars in 1322 bytes} [Mon Jul 25 06:00:42 2022] POST /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/os-volume_attachments => generated 194 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:43.907969 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8adb1c88-6e7b-4cc9-91ea-7ffecd4ad3c9 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:43.908837 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8adb1c88-6e7b-4cc9-91ea-7ffecd4ad3c9 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:43.916461 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8adb1c88-6e7b-4cc9-91ea-7ffecd4ad3c9 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:43.916887 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8adb1c88-6e7b-4cc9-91ea-7ffecd4ad3c9 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:43.917873 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8adb1c88-6e7b-4cc9-91ea-7ffecd4ad3c9 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:43.918313 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8adb1c88-6e7b-4cc9-91ea-7ffecd4ad3c9 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:44.151562 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8adb1c88-6e7b-4cc9-91ea-7ffecd4ad3c9 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:44.163041 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8adb1c88-6e7b-4cc9-91ea-7ffecd4ad3c9 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1314 microversion: 2.1 time: 0.259141 Jul 25 06:00:44.164043 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 156/297] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:43 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:44.623149 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-5516b0a9-4d2d-4f05-9ba5-ce11dc02f16f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:44.623905 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-5516b0a9-4d2d-4f05-9ba5-ce11dc02f16f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:44.634868 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5516b0a9-4d2d-4f05-9ba5-ce11dc02f16f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:44.637653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5516b0a9-4d2d-4f05-9ba5-ce11dc02f16f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:44.640152 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5516b0a9-4d2d-4f05-9ba5-ce11dc02f16f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:44.641497 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5516b0a9-4d2d-4f05-9ba5-ce11dc02f16f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:44.864623 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-485b3719-a0ef-4501-8a80-2b45a11c3100 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:44.871947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-485b3719-a0ef-4501-8a80-2b45a11c3100 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:44.897623 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-485b3719-a0ef-4501-8a80-2b45a11c3100 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:44.900797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-485b3719-a0ef-4501-8a80-2b45a11c3100 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:44.901881 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-485b3719-a0ef-4501-8a80-2b45a11c3100 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:44.902636 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-485b3719-a0ef-4501-8a80-2b45a11c3100 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:45.190647 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5516b0a9-4d2d-4f05-9ba5-ce11dc02f16f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:45.200774 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5516b0a9-4d2d-4f05-9ba5-ce11dc02f16f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:45.206457 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5516b0a9-4d2d-4f05-9ba5-ce11dc02f16f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:45.207999 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-5516b0a9-4d2d-4f05-9ba5-ce11dc02f16f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1721 microversion: 2.20 time: 0.590415 Jul 25 06:00:45.220435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 142/298] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:44 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1721 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:45.226094 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-df17b73f-5051-441c-97b0-0cb0402dca1b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:45.226753 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-df17b73f-5051-441c-97b0-0cb0402dca1b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:45.233853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-df17b73f-5051-441c-97b0-0cb0402dca1b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:45.234292 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-df17b73f-5051-441c-97b0-0cb0402dca1b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:45.235481 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-df17b73f-5051-441c-97b0-0cb0402dca1b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:45.236398 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-df17b73f-5051-441c-97b0-0cb0402dca1b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:45.314262 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-485b3719-a0ef-4501-8a80-2b45a11c3100 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:45.374186 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-485b3719-a0ef-4501-8a80-2b45a11c3100 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.501888 Jul 25 06:00:45.374186 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 157/299] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:44 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:45.509864 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-df17b73f-5051-441c-97b0-0cb0402dca1b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:45.519475 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-df17b73f-5051-441c-97b0-0cb0402dca1b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1314 microversion: 2.1 time: 0.297598 Jul 25 06:00:45.530953 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 143/300] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:45 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:46.227123 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-04ea42b8-2791-4e5d-b37f-85be0422e927 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:46.227941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-04ea42b8-2791-4e5d-b37f-85be0422e927 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:46.235523 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-04ea42b8-2791-4e5d-b37f-85be0422e927 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:46.236028 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-04ea42b8-2791-4e5d-b37f-85be0422e927 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:46.237830 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-04ea42b8-2791-4e5d-b37f-85be0422e927 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:46.240409 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-04ea42b8-2791-4e5d-b37f-85be0422e927 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:46.381976 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f243de62-59f0-4904-83bb-1facc790568b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:46.383237 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f243de62-59f0-4904-83bb-1facc790568b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:46.390286 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f243de62-59f0-4904-83bb-1facc790568b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:46.395767 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f243de62-59f0-4904-83bb-1facc790568b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:46.395767 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f243de62-59f0-4904-83bb-1facc790568b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:46.395767 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f243de62-59f0-4904-83bb-1facc790568b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:46.396095 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-04ea42b8-2791-4e5d-b37f-85be0422e927 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:46.402606 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-04ea42b8-2791-4e5d-b37f-85be0422e927 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:46.404468 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-04ea42b8-2791-4e5d-b37f-85be0422e927 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:46.406216 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-04ea42b8-2791-4e5d-b37f-85be0422e927 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1721 microversion: 2.20 time: 0.183889 Jul 25 06:00:46.418338 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 158/301] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:46 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:46.547591 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e3694264-3ba6-420b-af5c-8e2024e9d320 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-601361282", "imageRef": "bfffd6ef-7f99-4a99-90f3-027fe9c89821", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "805986bf-e25e-49a6-a0be-02e60deb2a2d"}], "security_groups": [{"name": "tempest-securitygroup--1449002934"}], "key_name": "tempest-keypair-1091290031", "user_data": "}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:46.561162 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-f243de62-59f0-4904-83bb-1facc790568b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:46.570882 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f243de62-59f0-4904-83bb-1facc790568b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.193419 Jul 25 06:00:46.573937 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 144/302] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:46 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:46.587978 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f61e1474-b566-4ea1-a3b2-11474e30bbfc tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:46.589461 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f61e1474-b566-4ea1-a3b2-11474e30bbfc tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:46.601750 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f61e1474-b566-4ea1-a3b2-11474e30bbfc tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:46.605308 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f61e1474-b566-4ea1-a3b2-11474e30bbfc tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:46.606261 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f61e1474-b566-4ea1-a3b2-11474e30bbfc tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:46.608264 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f61e1474-b566-4ea1-a3b2-11474e30bbfc tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:46.702309 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.network.neutron [None req-e3694264-3ba6-420b-af5c-8e2024e9d320 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] validate_networks() for [('805986bf-e25e-49a6-a0be-02e60deb2a2d', None, None, None, None, None)] {{(pid=130163) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:00:46.783925 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-f61e1474-b566-4ea1-a3b2-11474e30bbfc tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:46.795208 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f61e1474-b566-4ea1-a3b2-11474e30bbfc tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1498 microversion: 2.1 time: 0.217191 Jul 25 06:00:46.795803 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 145/303] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:46 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1498 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:47.429464 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-7df04fc8-8809-4b02-86ac-800c4deb07e9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:47.433160 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-7df04fc8-8809-4b02-86ac-800c4deb07e9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:47.438069 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-e3694264-3ba6-420b-af5c-8e2024e9d320 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Flavor limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:00:47.438593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-e3694264-3ba6-420b-af5c-8e2024e9d320 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Image limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:00:47.439185 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7df04fc8-8809-4b02-86ac-800c4deb07e9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:47.439637 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7df04fc8-8809-4b02-86ac-800c4deb07e9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:47.440186 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-e3694264-3ba6-420b-af5c-8e2024e9d320 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Flavor pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:00:47.440421 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7df04fc8-8809-4b02-86ac-800c4deb07e9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:47.440787 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-e3694264-3ba6-420b-af5c-8e2024e9d320 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Image pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:00:47.440901 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7df04fc8-8809-4b02-86ac-800c4deb07e9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:47.441520 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-e3694264-3ba6-420b-af5c-8e2024e9d320 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:00:47.457584 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e3694264-3ba6-420b-af5c-8e2024e9d320 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:47.461796 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e3694264-3ba6-420b-af5c-8e2024e9d320 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:47.461796 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e3694264-3ba6-420b-af5c-8e2024e9d320 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:47.461796 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e3694264-3ba6-420b-af5c-8e2024e9d320 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:47.499571 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-e3694264-3ba6-420b-af5c-8e2024e9d320 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Getting quotas for project 488e87a8233e4e69a07cd8efba37cad7. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:00:47.507214 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-e3694264-3ba6-420b-af5c-8e2024e9d320 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Getting quotas for user 6dc49525e3394668b4f1610c4badc144 and project 488e87a8233e4e69a07cd8efba37cad7. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:00:47.525591 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e3694264-3ba6-420b-af5c-8e2024e9d320 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Going to run 1 instances... {{(pid=130163) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:00:47.529508 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e3694264-3ba6-420b-af5c-8e2024e9d320 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfffd6ef-7f99-4a99-90f3-027fe9c89821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:00:47.650683 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e3694264-3ba6-420b-af5c-8e2024e9d320 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.116432 Jul 25 06:00:47.651516 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 159/304] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 06:00:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 06:00:47.662268 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6f596908-397a-40bd-a85c-eb109c865dc2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:47.666827 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6f596908-397a-40bd-a85c-eb109c865dc2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:47.673272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6f596908-397a-40bd-a85c-eb109c865dc2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:47.673913 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6f596908-397a-40bd-a85c-eb109c865dc2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:47.674918 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6f596908-397a-40bd-a85c-eb109c865dc2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:47.675514 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6f596908-397a-40bd-a85c-eb109c865dc2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:47.876451 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6f596908-397a-40bd-a85c-eb109c865dc2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:47.877755 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-7df04fc8-8809-4b02-86ac-800c4deb07e9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:47.888269 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6f596908-397a-40bd-a85c-eb109c865dc2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.229716 Jul 25 06:00:47.889915 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-7df04fc8-8809-4b02-86ac-800c4deb07e9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:47.899943 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 160/305] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:47 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:47.904729 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-7df04fc8-8809-4b02-86ac-800c4deb07e9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:47.905789 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-678522bc-acb8-4a0a-8621-05a5dad8d766 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:47.907069 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-678522bc-acb8-4a0a-8621-05a5dad8d766 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:47.911658 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-7df04fc8-8809-4b02-86ac-800c4deb07e9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1721 microversion: 2.20 time: 0.487798 Jul 25 06:00:47.920711 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 146/306] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:47 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1721 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:00:47.929740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-5c4e21f3-b09b-4c39-9633-3d4efe500161 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:47.930245 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-5c4e21f3-b09b-4c39-9633-3d4efe500161 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:47.958925 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5c4e21f3-b09b-4c39-9633-3d4efe500161 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:47.959607 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5c4e21f3-b09b-4c39-9633-3d4efe500161 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:47.960563 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5c4e21f3-b09b-4c39-9633-3d4efe500161 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:47.962533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5c4e21f3-b09b-4c39-9633-3d4efe500161 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:48.031394 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-678522bc-acb8-4a0a-8621-05a5dad8d766 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:48.032845 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-5c4e21f3-b09b-4c39-9633-3d4efe500161 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Going to try to terminate instance {{(pid=130162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:00:48.042504 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-678522bc-acb8-4a0a-8621-05a5dad8d766 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1241 microversion: 2.1 time: 0.138474 Jul 25 06:00:48.043090 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 161/307] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:47 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1241 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:48.441292 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-5c4e21f3-b09b-4c39-9633-3d4efe500161 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 204 len: 0 microversion: 2.1 time: 0.519607 Jul 25 06:00:48.442094 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 147/308] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:00:47 2022] DELETE /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:00:48.450903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e42536c6-3d7b-4a9c-8fa8-bb2399f704ff tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:48.451528 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e42536c6-3d7b-4a9c-8fa8-bb2399f704ff tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:48.459920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e42536c6-3d7b-4a9c-8fa8-bb2399f704ff tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:48.460588 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e42536c6-3d7b-4a9c-8fa8-bb2399f704ff tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:48.463274 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e42536c6-3d7b-4a9c-8fa8-bb2399f704ff tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:48.463274 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e42536c6-3d7b-4a9c-8fa8-bb2399f704ff tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:48.815559 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e42536c6-3d7b-4a9c-8fa8-bb2399f704ff tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:48.828783 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e42536c6-3d7b-4a9c-8fa8-bb2399f704ff tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1504 microversion: 2.1 time: 0.382191 Jul 25 06:00:48.829470 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 162/309] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:48 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:48.907577 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b0a5eccb-c169-4f0b-8036-5d88622595a9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:48.908411 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b0a5eccb-c169-4f0b-8036-5d88622595a9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:48.917672 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b0a5eccb-c169-4f0b-8036-5d88622595a9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:48.918119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b0a5eccb-c169-4f0b-8036-5d88622595a9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:48.919113 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b0a5eccb-c169-4f0b-8036-5d88622595a9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:48.920087 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b0a5eccb-c169-4f0b-8036-5d88622595a9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:48.935120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-72723340-ea52-48ea-8e9e-24bca5247005 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:48.935763 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-72723340-ea52-48ea-8e9e-24bca5247005 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:48.947135 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-72723340-ea52-48ea-8e9e-24bca5247005 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:48.951932 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-72723340-ea52-48ea-8e9e-24bca5247005 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:48.951932 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-72723340-ea52-48ea-8e9e-24bca5247005 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:48.954505 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-72723340-ea52-48ea-8e9e-24bca5247005 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:49.133505 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-72723340-ea52-48ea-8e9e-24bca5247005 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:49.149472 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-72723340-ea52-48ea-8e9e-24bca5247005 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:49.154935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-72723340-ea52-48ea-8e9e-24bca5247005 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:49.160101 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-72723340-ea52-48ea-8e9e-24bca5247005 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1721 microversion: 2.20 time: 0.228943 Jul 25 06:00:49.160682 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 163/310] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:48 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:49.166835 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-cd242657-4ad3-48ff-968d-b3589f343800 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:49.167966 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-cd242657-4ad3-48ff-968d-b3589f343800 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:49.175626 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-cd242657-4ad3-48ff-968d-b3589f343800 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:49.175939 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b0a5eccb-c169-4f0b-8036-5d88622595a9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:49.176665 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-cd242657-4ad3-48ff-968d-b3589f343800 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:49.178122 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-cd242657-4ad3-48ff-968d-b3589f343800 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:49.178577 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-cd242657-4ad3-48ff-968d-b3589f343800 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:49.188524 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b0a5eccb-c169-4f0b-8036-5d88622595a9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.286876 Jul 25 06:00:49.198998 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 148/311] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:48 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:49.273432 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-cd242657-4ad3-48ff-968d-b3589f343800 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:49.292950 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-cd242657-4ad3-48ff-968d-b3589f343800 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1245 microversion: 2.1 time: 0.131003 Jul 25 06:00:49.303217 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 164/312] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:49 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1245 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:49.847578 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-092f1329-925f-4517-91c8-de6d7d87597e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:49.848238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-092f1329-925f-4517-91c8-de6d7d87597e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:49.856381 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-092f1329-925f-4517-91c8-de6d7d87597e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:49.856830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-092f1329-925f-4517-91c8-de6d7d87597e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:49.857748 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-092f1329-925f-4517-91c8-de6d7d87597e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:49.858239 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-092f1329-925f-4517-91c8-de6d7d87597e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:50.015154 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-092f1329-925f-4517-91c8-de6d7d87597e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:50.025306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-092f1329-925f-4517-91c8-de6d7d87597e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1504 microversion: 2.1 time: 0.182544 Jul 25 06:00:50.025814 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 149/313] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:49 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:50.178577 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2490e871-ab31-4a5c-b2df-3093ac5ef7d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:50.179277 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2490e871-ab31-4a5c-b2df-3093ac5ef7d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:50.186155 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2490e871-ab31-4a5c-b2df-3093ac5ef7d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:50.186630 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2490e871-ab31-4a5c-b2df-3093ac5ef7d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:50.187403 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2490e871-ab31-4a5c-b2df-3093ac5ef7d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:50.187836 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2490e871-ab31-4a5c-b2df-3093ac5ef7d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:50.218195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-af6fcff6-4781-4bc9-a4cd-929dbab5e859 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:50.218968 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-af6fcff6-4781-4bc9-a4cd-929dbab5e859 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:50.225847 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-af6fcff6-4781-4bc9-a4cd-929dbab5e859 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:50.226381 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-af6fcff6-4781-4bc9-a4cd-929dbab5e859 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:50.227262 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-af6fcff6-4781-4bc9-a4cd-929dbab5e859 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:50.227882 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-af6fcff6-4781-4bc9-a4cd-929dbab5e859 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:50.341252 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2490e871-ab31-4a5c-b2df-3093ac5ef7d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:50.354090 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2490e871-ab31-4a5c-b2df-3093ac5ef7d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:50.355846 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2490e871-ab31-4a5c-b2df-3093ac5ef7d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:50.357647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2490e871-ab31-4a5c-b2df-3093ac5ef7d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1721 microversion: 2.20 time: 0.183053 Jul 25 06:00:50.358832 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 165/314] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:50 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:50.364012 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-04d94621-cf80-44bd-a7ec-a752d53f0165 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:50.364800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-04d94621-cf80-44bd-a7ec-a752d53f0165 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:50.371785 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-04d94621-cf80-44bd-a7ec-a752d53f0165 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:50.372495 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-04d94621-cf80-44bd-a7ec-a752d53f0165 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:50.373798 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-04d94621-cf80-44bd-a7ec-a752d53f0165 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:50.374513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-04d94621-cf80-44bd-a7ec-a752d53f0165 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:50.439321 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-af6fcff6-4781-4bc9-a4cd-929dbab5e859 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:50.449274 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-af6fcff6-4781-4bc9-a4cd-929dbab5e859 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.235235 Jul 25 06:00:50.452810 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 150/315] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:50 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:50.505128 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-04d94621-cf80-44bd-a7ec-a752d53f0165 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:50.520627 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-04d94621-cf80-44bd-a7ec-a752d53f0165 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1245 microversion: 2.1 time: 0.160411 Jul 25 06:00:50.523396 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 166/316] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:50 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1245 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:51.044236 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d5fb7d14-0dc2-4b1a-a019-2b8a7ee510ce tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:51.045491 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d5fb7d14-0dc2-4b1a-a019-2b8a7ee510ce tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:51.053627 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d5fb7d14-0dc2-4b1a-a019-2b8a7ee510ce tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:51.054090 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d5fb7d14-0dc2-4b1a-a019-2b8a7ee510ce tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:51.054919 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d5fb7d14-0dc2-4b1a-a019-2b8a7ee510ce tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:51.055351 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d5fb7d14-0dc2-4b1a-a019-2b8a7ee510ce tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:51.209558 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d5fb7d14-0dc2-4b1a-a019-2b8a7ee510ce tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:51.216950 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d5fb7d14-0dc2-4b1a-a019-2b8a7ee510ce tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1504 microversion: 2.1 time: 0.176797 Jul 25 06:00:51.217532 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 151/317] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:51 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:51.379650 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-1b3a9db8-4d04-4ec5-9e47-39ccb300618f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:51.381389 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-1b3a9db8-4d04-4ec5-9e47-39ccb300618f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:51.389978 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1b3a9db8-4d04-4ec5-9e47-39ccb300618f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:51.390432 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1b3a9db8-4d04-4ec5-9e47-39ccb300618f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:51.391581 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1b3a9db8-4d04-4ec5-9e47-39ccb300618f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:51.392253 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1b3a9db8-4d04-4ec5-9e47-39ccb300618f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:51.477650 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6e9d33f1-acf4-400e-aa96-b64bad2b34c5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:51.482869 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-6e9d33f1-acf4-400e-aa96-b64bad2b34c5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:51.505829 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6e9d33f1-acf4-400e-aa96-b64bad2b34c5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:51.505829 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6e9d33f1-acf4-400e-aa96-b64bad2b34c5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:51.508172 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6e9d33f1-acf4-400e-aa96-b64bad2b34c5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:51.508749 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6e9d33f1-acf4-400e-aa96-b64bad2b34c5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:51.748883 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-1b3a9db8-4d04-4ec5-9e47-39ccb300618f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:51.749681 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-6e9d33f1-acf4-400e-aa96-b64bad2b34c5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:51.764887 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-6e9d33f1-acf4-400e-aa96-b64bad2b34c5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.299090 Jul 25 06:00:51.765504 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-1b3a9db8-4d04-4ec5-9e47-39ccb300618f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:51.767245 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-1b3a9db8-4d04-4ec5-9e47-39ccb300618f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:51.768889 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-1b3a9db8-4d04-4ec5-9e47-39ccb300618f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1721 microversion: 2.20 time: 0.393289 Jul 25 06:00:51.776733 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 152/318] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:51 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:51.781096 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 167/319] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:51 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1721 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:51.785032 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-5a2a8988-0a2a-443e-aad5-a6fac0d01b0a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:51.785924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-5a2a8988-0a2a-443e-aad5-a6fac0d01b0a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:51.793568 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5a2a8988-0a2a-443e-aad5-a6fac0d01b0a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:51.794768 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5a2a8988-0a2a-443e-aad5-a6fac0d01b0a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:51.795908 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5a2a8988-0a2a-443e-aad5-a6fac0d01b0a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:51.796545 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5a2a8988-0a2a-443e-aad5-a6fac0d01b0a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:51.830700 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:51.865193 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5a2a8988-0a2a-443e-aad5-a6fac0d01b0a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:51.872516 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-5a2a8988-0a2a-443e-aad5-a6fac0d01b0a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1293 microversion: 2.1 time: 0.094637 Jul 25 06:00:51.873086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 153/320] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:51 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:52.235172 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-74590b65-8c10-41e3-9cc9-08ac9ae4f38d tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:52.238039 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-74590b65-8c10-41e3-9cc9-08ac9ae4f38d tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:52.245553 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-74590b65-8c10-41e3-9cc9-08ac9ae4f38d tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:52.245999 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-74590b65-8c10-41e3-9cc9-08ac9ae4f38d tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:52.251121 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-74590b65-8c10-41e3-9cc9-08ac9ae4f38d tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:52.251575 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-74590b65-8c10-41e3-9cc9-08ac9ae4f38d tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:52.550894 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-74590b65-8c10-41e3-9cc9-08ac9ae4f38d tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:52.561996 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-74590b65-8c10-41e3-9cc9-08ac9ae4f38d tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1504 microversion: 2.1 time: 0.331514 Jul 25 06:00:52.563033 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 168/321] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:52 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1504 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:52.648366 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-d6c05a63-3593-451d-b1c6-fcfb03fa3af3 req-3376e38c-2f14-4bd2-a030-e0054ebbd14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f657de8-5b01-4b65-bb0a-db7a32bb204a", "name": "network-vif-deleted", "tag": "775cd6db-de8a-45e9-b974-48b8a6124139"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:52.648366 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=4 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:52.650910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-d6c05a63-3593-451d-b1c6-fcfb03fa3af3 req-3376e38c-2f14-4bd2-a030-e0054ebbd14e service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:52.651352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-d6c05a63-3593-451d-b1c6-fcfb03fa3af3 req-3376e38c-2f14-4bd2-a030-e0054ebbd14e service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:52.663681 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-d6c05a63-3593-451d-b1c6-fcfb03fa3af3 req-3376e38c-2f14-4bd2-a030-e0054ebbd14e service nova] Creating event network-vif-deleted:775cd6db-de8a-45e9-b974-48b8a6124139 for instance 5f657de8-5b01-4b65-bb0a-db7a32bb204a on hv-cinder-85083 Jul 25 06:00:52.668626 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-d6c05a63-3593-451d-b1c6-fcfb03fa3af3 req-3376e38c-2f14-4bd2-a030-e0054ebbd14e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033877 Jul 25 06:00:52.669592 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 154/322] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:52.795193 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-5dfd67d9-14db-4c8e-ac52-37ec968058e3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:52.799005 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9304b990-530a-4aa5-9d30-e57373b731c7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:52.799005 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-9304b990-530a-4aa5-9d30-e57373b731c7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:52.799743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-5dfd67d9-14db-4c8e-ac52-37ec968058e3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:52.808143 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5dfd67d9-14db-4c8e-ac52-37ec968058e3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:52.808461 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9304b990-530a-4aa5-9d30-e57373b731c7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:52.808624 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5dfd67d9-14db-4c8e-ac52-37ec968058e3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:52.809243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9304b990-530a-4aa5-9d30-e57373b731c7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:52.809366 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5dfd67d9-14db-4c8e-ac52-37ec968058e3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:52.809775 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5dfd67d9-14db-4c8e-ac52-37ec968058e3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:52.810736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9304b990-530a-4aa5-9d30-e57373b731c7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:52.811172 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9304b990-530a-4aa5-9d30-e57373b731c7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:52.976030 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9304b990-530a-4aa5-9d30-e57373b731c7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:52.985280 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9304b990-530a-4aa5-9d30-e57373b731c7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1503 microversion: 2.1 time: 0.197966 Jul 25 06:00:52.988660 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 169/323] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:52 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1503 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:52.994300 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-555faf8d-7a0a-4aa1-bcda-9d14dea514de tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:52.995155 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-555faf8d-7a0a-4aa1-bcda-9d14dea514de tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:53.010676 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-555faf8d-7a0a-4aa1-bcda-9d14dea514de tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:53.011540 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-555faf8d-7a0a-4aa1-bcda-9d14dea514de tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:53.012710 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-555faf8d-7a0a-4aa1-bcda-9d14dea514de tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:53.013474 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-555faf8d-7a0a-4aa1-bcda-9d14dea514de tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:53.063735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5dfd67d9-14db-4c8e-ac52-37ec968058e3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:53.074590 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5dfd67d9-14db-4c8e-ac52-37ec968058e3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:53.076505 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5dfd67d9-14db-4c8e-ac52-37ec968058e3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:53.077956 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-5dfd67d9-14db-4c8e-ac52-37ec968058e3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1721 microversion: 2.20 time: 0.293604 Jul 25 06:00:53.089488 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 155/324] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:52 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1721 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:53.094034 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-555faf8d-7a0a-4aa1-bcda-9d14dea514de tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:53.095313 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-791921d4-d46d-4aad-94e5-6070ebab7658 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3afb88fb-2652-4798-a104-213effa0478f"}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:53.096597 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-791921d4-d46d-4aad-94e5-6070ebab7658 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:53.099021 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=100 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:53.104036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-791921d4-d46d-4aad-94e5-6070ebab7658 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:53.104559 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-791921d4-d46d-4aad-94e5-6070ebab7658 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:53.105596 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-791921d4-d46d-4aad-94e5-6070ebab7658 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:53.105824 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-555faf8d-7a0a-4aa1-bcda-9d14dea514de tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1301 microversion: 2.1 time: 0.115679 Jul 25 06:00:53.106428 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-791921d4-d46d-4aad-94e5-6070ebab7658 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:53.106851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 170/325] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:52 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1301 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:53.130524 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-791921d4-d46d-4aad-94e5-6070ebab7658 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] HTTP exception thrown: Cannot 'attach_volume' instance 0848c502-1383-407a-94d1-b92892dff9e4 while it is in vm_state rescued Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-791921d4-d46d-4aad-94e5-6070ebab7658 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Request method failure captured: Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: POST /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4/os-volume_attachments HTTP/1.1 Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 74 Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEZ4GGYvj3dFL4Uvy0H58MbEz8LS_j1xNyRrePuqYNvuonp37ZlLQzY-ecjA9G73v3nGfUkWB72NIpUwhxL4BqIVyX_Mn5ZzBP_FUiEZF7oEl0i1jsl7C4MT7_85De_hItI1_J9Ix0rEBcWjJHmdYXrs4LT93CcXorpqBHUMGlS-DY Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: d30518907b9f4939b1e8666eba12186e Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-160252649 Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:00:53.133131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:00:53.134745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d30518907b9f4939b1e8666eba12186e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d30518907b9f4939b1e8666eba12186e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d30518907b9f4939b1e8666eba12186e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d30518907b9f4939b1e8666eba12186e", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:00:53.134745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-ServerRescueNegativeTestJSON-160252649 Jul 25 06:00:53.134745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: d30518907b9f4939b1e8666eba12186e Jul 25 06:00:53.134745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-160252649 Jul 25 06:00:53.134745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-ServerRescueNegativeTestJSON-160252649-project Jul 25 06:00:53.134745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:00:53.134745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:00:53.134745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 13e5d648af294c7cbc86ccd362914728 Jul 25 06:00:53.134745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-ServerRescueNegativeTestJSON-160252649-project Jul 25 06:00:53.134745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Jul 25 06:00:53.134745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {"volumeAttachment": {"volumeId": "3afb88fb-2652-4798-a104-213effa0478f"}} Jul 25 06:00:53.134745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Cannot 'attach_volume' instance 0848c502-1383-407a-94d1-b92892dff9e4 while it is in vm_state rescued Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'server_id': '0848c502-1383-407a-94d1-b92892dff9e4', 'body': {'volumeAttachment': {'volumeId': '3afb88fb-2652-4798-a104-213effa0478f'}}} Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0848c502-1383-407a-94d1-b92892dff9e4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:00:53.135667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0848c502-1383-407a-94d1-b92892dff9e4 while it is in vm_state rescued Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:00:53.136813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:00:53.137879 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:00:53.137879 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:00:53.137879 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0848c502-1383-407a-94d1-b92892dff9e4 while it is in vm_state rescued Jul 25 06:00:53.137879 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:00:53.139275 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-791921d4-d46d-4aad-94e5-6070ebab7658 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Returning 409 to user: Cannot 'attach_volume' instance 0848c502-1383-407a-94d1-b92892dff9e4 while it is in vm_state rescued {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:00:53.140133 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-791921d4-d46d-4aad-94e5-6070ebab7658 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "POST /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049334 Jul 25 06:00:53.140694 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 156/326] 10.222.0.17 () {60 vars in 1322 bytes} [Mon Jul 25 06:00:53 2022] POST /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 06:00:53.151569 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c45a891a-f686-4eb7-b176-39ab5680c5c6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:53.152093 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c45a891a-f686-4eb7-b176-39ab5680c5c6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:53.158401 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c45a891a-f686-4eb7-b176-39ab5680c5c6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:53.158886 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c45a891a-f686-4eb7-b176-39ab5680c5c6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:53.159676 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c45a891a-f686-4eb7-b176-39ab5680c5c6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:53.160114 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c45a891a-f686-4eb7-b176-39ab5680c5c6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:53.372526 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c45a891a-f686-4eb7-b176-39ab5680c5c6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "POST /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4/action" status: 202 len: 0 microversion: 2.1 time: 0.226044 Jul 25 06:00:53.383009 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b667720b-36b6-4fd7-8d1d-8aaac5521b14 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:53.383683 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b667720b-36b6-4fd7-8d1d-8aaac5521b14 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:53.384463 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 171/327] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 06:00:53 2022] POST /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:00:53.401570 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b667720b-36b6-4fd7-8d1d-8aaac5521b14 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:53.402015 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b667720b-36b6-4fd7-8d1d-8aaac5521b14 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:53.402812 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b667720b-36b6-4fd7-8d1d-8aaac5521b14 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:53.403499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b667720b-36b6-4fd7-8d1d-8aaac5521b14 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:53.582907 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-36b85db4-efc8-4c6b-8708-bd03bcefe31e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:53.584842 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-36b85db4-efc8-4c6b-8708-bd03bcefe31e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:53.591256 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-36b85db4-efc8-4c6b-8708-bd03bcefe31e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:53.592154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-36b85db4-efc8-4c6b-8708-bd03bcefe31e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:53.593005 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-36b85db4-efc8-4c6b-8708-bd03bcefe31e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:53.593539 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-36b85db4-efc8-4c6b-8708-bd03bcefe31e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:53.630111 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-36b85db4-efc8-4c6b-8708-bd03bcefe31e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:53.631026 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-36b85db4-efc8-4c6b-8708-bd03bcefe31e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:53.631928 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.objects.instance [None req-36b85db4-efc8-4c6b-8708-bd03bcefe31e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lazy-loading 'fault' on Instance uuid 5f657de8-5b01-4b65-bb0a-db7a32bb204a {{(pid=130163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:00:53.728926 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b667720b-36b6-4fd7-8d1d-8aaac5521b14 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:53.743344 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b667720b-36b6-4fd7-8d1d-8aaac5521b14 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1511 microversion: 2.1 time: 0.365041 Jul 25 06:00:53.745693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-36b85db4-efc8-4c6b-8708-bd03bcefe31e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:53.756948 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 157/328] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:53 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1511 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:53.783503 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-36b85db4-efc8-4c6b-8708-bd03bcefe31e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 200 len: 1304 microversion: 2.1 time: 0.183343 Jul 25 06:00:53.783503 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 172/329] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:53 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 1304 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:53.900114 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0bbff57f-e1bb-4f94-ae49-0dda87167162 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:53.916938 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0bbff57f-e1bb-4f94-ae49-0dda87167162 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:53.919337 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0bbff57f-e1bb-4f94-ae49-0dda87167162 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:54.029464 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0bbff57f-e1bb-4f94-ae49-0dda87167162 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Going to try to stop instance {{(pid=130162) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 06:00:54.097735 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a803491c-a72a-4658-83f2-09e767976ae9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:54.098347 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a803491c-a72a-4658-83f2-09e767976ae9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:54.109996 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a803491c-a72a-4658-83f2-09e767976ae9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:54.111098 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a803491c-a72a-4658-83f2-09e767976ae9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:54.112346 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a803491c-a72a-4658-83f2-09e767976ae9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:54.112873 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a803491c-a72a-4658-83f2-09e767976ae9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:54.309853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0bbff57f-e1bb-4f94-ae49-0dda87167162 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "POST /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/action" status: 202 len: 0 microversion: 2.1 time: 0.413897 Jul 25 06:00:54.310804 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 158/330] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 06:00:53 2022] POST /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:00:54.337288 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-eb71ff70-4e97-401f-bb07-50e483dcb97e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:54.338951 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-eb71ff70-4e97-401f-bb07-50e483dcb97e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:54.340440 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a803491c-a72a-4658-83f2-09e767976ae9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:54.345933 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eb71ff70-4e97-401f-bb07-50e483dcb97e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:54.346566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eb71ff70-4e97-401f-bb07-50e483dcb97e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:54.351432 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eb71ff70-4e97-401f-bb07-50e483dcb97e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:54.351432 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eb71ff70-4e97-401f-bb07-50e483dcb97e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:54.359387 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a803491c-a72a-4658-83f2-09e767976ae9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:54.361160 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a803491c-a72a-4658-83f2-09e767976ae9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:54.362397 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a803491c-a72a-4658-83f2-09e767976ae9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1721 microversion: 2.20 time: 0.269318 Jul 25 06:00:54.364863 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 173/331] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:54 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:00:54.373217 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4425a8e2-e87b-49de-8c4c-9a930d177b6d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:54.374115 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4425a8e2-e87b-49de-8c4c-9a930d177b6d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:54.388174 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4425a8e2-e87b-49de-8c4c-9a930d177b6d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:54.388629 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4425a8e2-e87b-49de-8c4c-9a930d177b6d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:54.389414 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4425a8e2-e87b-49de-8c4c-9a930d177b6d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:54.389848 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4425a8e2-e87b-49de-8c4c-9a930d177b6d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:54.495951 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-eb71ff70-4e97-401f-bb07-50e483dcb97e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:54.504484 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-eb71ff70-4e97-401f-bb07-50e483dcb97e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1299 microversion: 2.1 time: 0.192221 Jul 25 06:00:54.511047 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 159/332] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:54 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1299 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:54.564069 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4425a8e2-e87b-49de-8c4c-9a930d177b6d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:54.573592 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4425a8e2-e87b-49de-8c4c-9a930d177b6d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1726 microversion: 2.1 time: 0.206730 Jul 25 06:00:54.578687 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 174/333] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:54 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1726 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:54.768256 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-457d48ed-e726-4031-820e-3a9545c95bdd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:54.770275 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-457d48ed-e726-4031-820e-3a9545c95bdd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:54.782088 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-457d48ed-e726-4031-820e-3a9545c95bdd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:54.782998 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-457d48ed-e726-4031-820e-3a9545c95bdd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:54.785310 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-457d48ed-e726-4031-820e-3a9545c95bdd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:54.786365 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-457d48ed-e726-4031-820e-3a9545c95bdd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:54.797289 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-fdbba595-591b-4ac4-818a-7c3df70edb65 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:54.798554 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-fdbba595-591b-4ac4-818a-7c3df70edb65 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 5f657de8-5b01-4b65-bb0a-db7a32bb204a] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:54.807373 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fdbba595-591b-4ac4-818a-7c3df70edb65 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:54.808103 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fdbba595-591b-4ac4-818a-7c3df70edb65 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:54.809084 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fdbba595-591b-4ac4-818a-7c3df70edb65 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:54.809697 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fdbba595-591b-4ac4-818a-7c3df70edb65 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:54.836439 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-fdbba595-591b-4ac4-818a-7c3df70edb65 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] HTTP exception thrown: Instance 5f657de8-5b01-4b65-bb0a-db7a32bb204a could not be found. Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-fdbba595-591b-4ac4-818a-7c3df70edb65 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Request method failure captured: Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a HTTP/1.1 Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jF8uVwkC3xv6JIfE8yRIhTseoIA9wWKW9W6bbqZIPT-EVWHmqStV4pXI26q34wDBcAXz6YCFz9yOu592K6tkfNkpzr6JrqfylVH74GofbV-4HqBSlj5mQkbhN1L-kS7nEYzcOmaarnsQUz0HXeua6b27e972BPCNgBUKH0xtNwOkLo Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 011cdb0f00b9444c812ac101bc5b43e3 Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-VolumesActionsTest-1933252008 Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:00:54.839811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:00:54.841038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/011cdb0f00b9444c812ac101bc5b43e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/011cdb0f00b9444c812ac101bc5b43e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/011cdb0f00b9444c812ac101bc5b43e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_011cdb0f00b9444c812ac101bc5b43e3", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:00:54.841038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-VolumesActionsTest-1933252008 Jul 25 06:00:54.841038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 011cdb0f00b9444c812ac101bc5b43e3 Jul 25 06:00:54.841038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-VolumesActionsTest-1933252008 Jul 25 06:00:54.841038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-VolumesActionsTest-1933252008-project Jul 25 06:00:54.841038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:00:54.841038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:00:54.841038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: a01061da6fc0404facce47e669ec80af Jul 25 06:00:54.841038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-VolumesActionsTest-1933252008-project Jul 25 06:00:54.841038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:00:54.841038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 5f657de8-5b01-4b65-bb0a-db7a32bb204a could not be found. Jul 25 06:00:54.841038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '5f657de8-5b01-4b65-bb0a-db7a32bb204a'} Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f657de8-5b01-4b65-bb0a-db7a32bb204a could not be found. Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:00:54.841759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f657de8-5b01-4b65-bb0a-db7a32bb204a could not be found. Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f657de8-5b01-4b65-bb0a-db7a32bb204a could not be found. Jul 25 06:00:54.843442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:00:54.846186 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-fdbba595-591b-4ac4-818a-7c3df70edb65 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Returning 404 to user: Instance 5f657de8-5b01-4b65-bb0a-db7a32bb204a could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:00:54.847408 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-fdbba595-591b-4ac4-818a-7c3df70edb65 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a" status: 404 len: 111 microversion: 2.1 time: 0.057110 Jul 25 06:00:54.852704 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 175/334] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:54 2022] GET /compute/v2.1/servers/5f657de8-5b01-4b65-bb0a-db7a32bb204a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:00:54.996151 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-dce78e81-ed1f-4880-9609-ea79643188fa tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1931106352", "imageRef": "bfffd6ef-7f99-4a99-90f3-027fe9c89821", "flavorRef": "452", "networks": [{"uuid": "63c40e02-062b-4ed7-ae6f-d46901ed1af6"}]}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:55.004125 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:55.093948 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.network.neutron [None req-dce78e81-ed1f-4880-9609-ea79643188fa tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] validate_networks() for [('63c40e02-062b-4ed7-ae6f-d46901ed1af6', None, None, None, None, None)] {{(pid=130163) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:00:55.208006 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-457d48ed-e726-4031-820e-3a9545c95bdd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:55.226800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-457d48ed-e726-4031-820e-3a9545c95bdd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1511 microversion: 2.1 time: 0.468844 Jul 25 06:00:55.227978 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 160/335] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:54 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1511 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:55.389708 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-42324c21-dfa9-4ea4-b886-3cc037d2ffc3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:55.398292 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-42324c21-dfa9-4ea4-b886-3cc037d2ffc3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:55.433577 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-42324c21-dfa9-4ea4-b886-3cc037d2ffc3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:55.434333 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-42324c21-dfa9-4ea4-b886-3cc037d2ffc3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:55.435386 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-42324c21-dfa9-4ea4-b886-3cc037d2ffc3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:55.438445 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-42324c21-dfa9-4ea4-b886-3cc037d2ffc3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:55.777499 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-dce78e81-ed1f-4880-9609-ea79643188fa tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Flavor limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:00:55.779442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-dce78e81-ed1f-4880-9609-ea79643188fa tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Image limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:00:55.782550 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-dce78e81-ed1f-4880-9609-ea79643188fa tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Flavor pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:00:55.783826 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-dce78e81-ed1f-4880-9609-ea79643188fa tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Image pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:00:55.788630 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-dce78e81-ed1f-4880-9609-ea79643188fa tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:00:55.816131 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dce78e81-ed1f-4880-9609-ea79643188fa tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:55.818041 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dce78e81-ed1f-4880-9609-ea79643188fa tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:55.819950 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dce78e81-ed1f-4880-9609-ea79643188fa tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:55.820972 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dce78e81-ed1f-4880-9609-ea79643188fa tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:55.865616 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-dce78e81-ed1f-4880-9609-ea79643188fa tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Getting quotas for project 011cdb0f00b9444c812ac101bc5b43e3. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:00:55.868673 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-dce78e81-ed1f-4880-9609-ea79643188fa tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Getting quotas for user a01061da6fc0404facce47e669ec80af and project 011cdb0f00b9444c812ac101bc5b43e3. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:00:55.883490 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-dce78e81-ed1f-4880-9609-ea79643188fa tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Going to run 1 instances... {{(pid=130163) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:00:55.886003 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-dce78e81-ed1f-4880-9609-ea79643188fa tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfffd6ef-7f99-4a99-90f3-027fe9c89821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:00:56.076234 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-dce78e81-ed1f-4880-9609-ea79643188fa tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.083996 Jul 25 06:00:56.077056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 176/336] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 06:00:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 06:00:56.082112 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f63873b4-5374-44d5-9df8-2087b29b039e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:56.083057 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f63873b4-5374-44d5-9df8-2087b29b039e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:56.089526 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f63873b4-5374-44d5-9df8-2087b29b039e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:56.096137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f63873b4-5374-44d5-9df8-2087b29b039e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:56.096137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f63873b4-5374-44d5-9df8-2087b29b039e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:56.096137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f63873b4-5374-44d5-9df8-2087b29b039e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:56.110867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-42324c21-dfa9-4ea4-b886-3cc037d2ffc3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:56.122696 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-42324c21-dfa9-4ea4-b886-3cc037d2ffc3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:56.127454 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-42324c21-dfa9-4ea4-b886-3cc037d2ffc3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:56.127454 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-42324c21-dfa9-4ea4-b886-3cc037d2ffc3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1721 microversion: 2.20 time: 0.742471 Jul 25 06:00:56.127454 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 161/337] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:55 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1721 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:56.139502 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-834361a3-7818-4083-bcbf-dcd9d7e9aaf8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:56.140421 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-834361a3-7818-4083-bcbf-dcd9d7e9aaf8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:56.162431 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-834361a3-7818-4083-bcbf-dcd9d7e9aaf8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:56.163718 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-834361a3-7818-4083-bcbf-dcd9d7e9aaf8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:56.165368 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-834361a3-7818-4083-bcbf-dcd9d7e9aaf8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:56.165855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-834361a3-7818-4083-bcbf-dcd9d7e9aaf8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:56.200845 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f63873b4-5374-44d5-9df8-2087b29b039e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:56.206115 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f63873b4-5374-44d5-9df8-2087b29b039e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1299 microversion: 2.1 time: 0.127838 Jul 25 06:00:56.206721 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 177/338] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:56 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1299 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:56.220074 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ad61b9a5-f3db-4db0-8ec7-885917dda5d5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:56.220859 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ad61b9a5-f3db-4db0-8ec7-885917dda5d5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:56.289732 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ad61b9a5-f3db-4db0-8ec7-885917dda5d5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:56.299194 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ad61b9a5-f3db-4db0-8ec7-885917dda5d5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1214 microversion: 2.1 time: 0.090992 Jul 25 06:00:56.299851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 178/339] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:56 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:56.306353 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-84b526ab-d74d-4916-abb8-53400e3d61d9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:56.307452 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-84b526ab-d74d-4916-abb8-53400e3d61d9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:56.317479 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-84b526ab-d74d-4916-abb8-53400e3d61d9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:56.318277 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-84b526ab-d74d-4916-abb8-53400e3d61d9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:56.319450 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-84b526ab-d74d-4916-abb8-53400e3d61d9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:56.320437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-84b526ab-d74d-4916-abb8-53400e3d61d9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:56.503637 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-84b526ab-d74d-4916-abb8-53400e3d61d9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:56.520256 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-84b526ab-d74d-4916-abb8-53400e3d61d9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1511 microversion: 2.1 time: 0.218699 Jul 25 06:00:56.525647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 179/340] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:56 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1511 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:56.576974 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-834361a3-7818-4083-bcbf-dcd9d7e9aaf8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:56.588329 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-834361a3-7818-4083-bcbf-dcd9d7e9aaf8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1726 microversion: 2.1 time: 0.460710 Jul 25 06:00:56.588899 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 162/341] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:56 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1726 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:57.149364 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8d3fc854-e0c5-4289-afff-0bcfa6d2697e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:57.149364 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8d3fc854-e0c5-4289-afff-0bcfa6d2697e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:57.158436 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8d3fc854-e0c5-4289-afff-0bcfa6d2697e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:57.158922 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8d3fc854-e0c5-4289-afff-0bcfa6d2697e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:57.160605 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8d3fc854-e0c5-4289-afff-0bcfa6d2697e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:57.161147 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8d3fc854-e0c5-4289-afff-0bcfa6d2697e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:57.223229 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e8ff554b-7b83-4a38-aa70-7b6806f329c4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:57.223843 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e8ff554b-7b83-4a38-aa70-7b6806f329c4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:57.243635 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e8ff554b-7b83-4a38-aa70-7b6806f329c4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:57.244229 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e8ff554b-7b83-4a38-aa70-7b6806f329c4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:57.245579 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e8ff554b-7b83-4a38-aa70-7b6806f329c4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:57.246121 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e8ff554b-7b83-4a38-aa70-7b6806f329c4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:57.406022 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e8ff554b-7b83-4a38-aa70-7b6806f329c4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:57.415551 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e8ff554b-7b83-4a38-aa70-7b6806f329c4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1367 microversion: 2.1 time: 0.196109 Jul 25 06:00:57.416615 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 163/342] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:57 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:57.448300 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8d3fc854-e0c5-4289-afff-0bcfa6d2697e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:57.458249 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8d3fc854-e0c5-4289-afff-0bcfa6d2697e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:57.460720 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8d3fc854-e0c5-4289-afff-0bcfa6d2697e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:57.462409 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8d3fc854-e0c5-4289-afff-0bcfa6d2697e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1742 microversion: 2.20 time: 0.321764 Jul 25 06:00:57.474745 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 180/343] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:57 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1742 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:57.477251 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7eab2bc8-44c1-466f-a95e-1b204b03b279 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:57.477856 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7eab2bc8-44c1-466f-a95e-1b204b03b279 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:57.489705 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7eab2bc8-44c1-466f-a95e-1b204b03b279 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:57.490425 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7eab2bc8-44c1-466f-a95e-1b204b03b279 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:57.491738 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7eab2bc8-44c1-466f-a95e-1b204b03b279 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:57.493356 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7eab2bc8-44c1-466f-a95e-1b204b03b279 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:57.580095 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7eab2bc8-44c1-466f-a95e-1b204b03b279 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:57.588707 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-7eab2bc8-44c1-466f-a95e-1b204b03b279 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1218 microversion: 2.1 time: 0.116529 Jul 25 06:00:57.589501 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 181/344] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:57 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:57.594606 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-717fb028-e9ff-46cc-af68-471f0c15dbdd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:57.595333 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-717fb028-e9ff-46cc-af68-471f0c15dbdd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:57.604990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-717fb028-e9ff-46cc-af68-471f0c15dbdd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:57.605757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-717fb028-e9ff-46cc-af68-471f0c15dbdd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:57.606919 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-717fb028-e9ff-46cc-af68-471f0c15dbdd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:57.607417 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-717fb028-e9ff-46cc-af68-471f0c15dbdd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:57.678549 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-38cca7ea-3d49-4f96-9c31-b1f1f904055d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Action: 'create', calling method: .version_select at 0x7f9d36a46c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-2041156438", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAUXl4qhGLnwqtDwp7qsR0BjtBVJtaEw9xgv2Tx+jXLIeayX66+nzQZKvnRBJpaQFiffqO5uzHiZG6Y5NpnHhhEAryAZbVsElKQxx5dO13bV+Vmdd5aSWZoKt1MZZwevA=="}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:57.698818 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-38cca7ea-3d49-4f96-9c31-b1f1f904055d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Getting quotas for project 52a1423a26e041959827c5d8611cffdf. Resources: {'key_pairs'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:00:57.703191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-38cca7ea-3d49-4f96-9c31-b1f1f904055d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Getting quotas for user d03b404df6d54b638804804bbc08e1cf and project 52a1423a26e041959827c5d8611cffdf. Resources: {'key_pairs'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:00:57.784273 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-717fb028-e9ff-46cc-af68-471f0c15dbdd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:57.794061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-717fb028-e9ff-46cc-af68-471f0c15dbdd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1511 microversion: 2.1 time: 0.203468 Jul 25 06:00:57.794801 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 182/345] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:57 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:57.799451 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a6eb2485-2513-4903-956f-279337b69cdc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:57.800050 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a6eb2485-2513-4903-956f-279337b69cdc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:57.807232 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a6eb2485-2513-4903-956f-279337b69cdc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:57.810426 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a6eb2485-2513-4903-956f-279337b69cdc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:57.810426 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a6eb2485-2513-4903-956f-279337b69cdc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:57.810426 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a6eb2485-2513-4903-956f-279337b69cdc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:57.835421 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-38cca7ea-3d49-4f96-9c31-b1f1f904055d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.417422 Jul 25 06:00:57.841652 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 164/346] 10.222.0.17 () {60 vars in 1158 bytes} [Mon Jul 25 06:00:57 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:57.959394 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a6eb2485-2513-4903-956f-279337b69cdc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:57.967541 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a6eb2485-2513-4903-956f-279337b69cdc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1726 microversion: 2.1 time: 0.171583 Jul 25 06:00:57.968164 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 183/347] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:57 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:58.442396 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8b2eebef-c150-4579-87a5-f43830d60f11 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:58.445695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8b2eebef-c150-4579-87a5-f43830d60f11 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:58.457443 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8b2eebef-c150-4579-87a5-f43830d60f11 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:58.457900 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8b2eebef-c150-4579-87a5-f43830d60f11 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:58.463273 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8b2eebef-c150-4579-87a5-f43830d60f11 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:58.463807 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8b2eebef-c150-4579-87a5-f43830d60f11 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:58.484271 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-cdfa9971-427c-4441-bda2-63d3d5633c8c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:58.485392 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-cdfa9971-427c-4441-bda2-63d3d5633c8c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:58.496241 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-cdfa9971-427c-4441-bda2-63d3d5633c8c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:58.499812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-cdfa9971-427c-4441-bda2-63d3d5633c8c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:58.500880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-cdfa9971-427c-4441-bda2-63d3d5633c8c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:58.501503 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-cdfa9971-427c-4441-bda2-63d3d5633c8c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:58.741208 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8b2eebef-c150-4579-87a5-f43830d60f11 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:58.753780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-8b2eebef-c150-4579-87a5-f43830d60f11 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1367 microversion: 2.1 time: 0.324035 Jul 25 06:00:58.767079 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 165/348] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:58 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:58.788217 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3cc4bdb3-8343-441f-a4bb-87fbd9537490 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:58.788217 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3cc4bdb3-8343-441f-a4bb-87fbd9537490 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:58.789791 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:58.791833 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3cc4bdb3-8343-441f-a4bb-87fbd9537490 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:58.792505 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3cc4bdb3-8343-441f-a4bb-87fbd9537490 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:58.793537 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3cc4bdb3-8343-441f-a4bb-87fbd9537490 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:58.794292 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3cc4bdb3-8343-441f-a4bb-87fbd9537490 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:58.870918 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3cc4bdb3-8343-441f-a4bb-87fbd9537490 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:58.887943 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3cc4bdb3-8343-441f-a4bb-87fbd9537490 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1210 microversion: 2.1 time: 0.114281 Jul 25 06:00:58.887943 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 166/349] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:58 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1210 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:58.888178 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-cdfa9971-427c-4441-bda2-63d3d5633c8c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:58.891709 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ae385195-1581-4942-afc2-0d596f4835d9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:58.895477 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ae385195-1581-4942-afc2-0d596f4835d9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:58.896743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-cdfa9971-427c-4441-bda2-63d3d5633c8c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:58.898767 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-cdfa9971-427c-4441-bda2-63d3d5633c8c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:58.900394 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-cdfa9971-427c-4441-bda2-63d3d5633c8c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1742 microversion: 2.20 time: 0.419829 Jul 25 06:00:58.901569 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 184/350] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:58 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1742 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:58.905350 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ae385195-1581-4942-afc2-0d596f4835d9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:58.914538 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ae385195-1581-4942-afc2-0d596f4835d9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:58.915451 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ae385195-1581-4942-afc2-0d596f4835d9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:58.915944 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ae385195-1581-4942-afc2-0d596f4835d9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:58.989008 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-10c03d55-16f2-47ad-a725-4357d7bd1d47 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:58.995760 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-10c03d55-16f2-47ad-a725-4357d7bd1d47 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:59.022580 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-10c03d55-16f2-47ad-a725-4357d7bd1d47 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:59.023309 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-10c03d55-16f2-47ad-a725-4357d7bd1d47 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:59.026551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-10c03d55-16f2-47ad-a725-4357d7bd1d47 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:59.027381 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-10c03d55-16f2-47ad-a725-4357d7bd1d47 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:59.286144 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-10c03d55-16f2-47ad-a725-4357d7bd1d47 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:59.298573 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-10c03d55-16f2-47ad-a725-4357d7bd1d47 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1726 microversion: 2.1 time: 0.318522 Jul 25 06:00:59.300770 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 185/351] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:58 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1726 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:59.379404 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ae385195-1581-4942-afc2-0d596f4835d9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:59.393779 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ae385195-1581-4942-afc2-0d596f4835d9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1511 microversion: 2.1 time: 0.508833 Jul 25 06:00:59.394724 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 167/352] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:58 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1511 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:59.668353 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-793b4bdd-79fc-46dd-94c0-fbf20a3f22cf req-f9ce0734-9b82-4251-9e6b-8e42e83b2716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb485129-6941-49db-9cee-c83f53f2bdff", "tag": "08aafc3d-895b-4cc7-84fd-174d4858268a"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:59.688102 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-793b4bdd-79fc-46dd-94c0-fbf20a3f22cf req-f9ce0734-9b82-4251-9e6b-8e42e83b2716 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:59.688839 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-793b4bdd-79fc-46dd-94c0-fbf20a3f22cf req-f9ce0734-9b82-4251-9e6b-8e42e83b2716 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:59.721506 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-793b4bdd-79fc-46dd-94c0-fbf20a3f22cf req-f9ce0734-9b82-4251-9e6b-8e42e83b2716 service nova] Creating event network-changed:08aafc3d-895b-4cc7-84fd-174d4858268a for instance fb485129-6941-49db-9cee-c83f53f2bdff on hv-cinder-85083 Jul 25 06:00:59.737605 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-793b4bdd-79fc-46dd-94c0-fbf20a3f22cf req-f9ce0734-9b82-4251-9e6b-8e42e83b2716 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076996 Jul 25 06:00:59.738877 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 186/353] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:59.775278 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b5af98d4-0929-4747-bb08-92c789e27c0d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:59.777325 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b5af98d4-0929-4747-bb08-92c789e27c0d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:59.785142 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b5af98d4-0929-4747-bb08-92c789e27c0d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:59.786155 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b5af98d4-0929-4747-bb08-92c789e27c0d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:59.790613 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b5af98d4-0929-4747-bb08-92c789e27c0d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:59.791375 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b5af98d4-0929-4747-bb08-92c789e27c0d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:59.903436 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c3d3023f-cc78-418d-8336-8fa21df1b129 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:59.904226 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c3d3023f-cc78-418d-8336-8fa21df1b129 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:59.918974 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c3d3023f-cc78-418d-8336-8fa21df1b129 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:59.919620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c3d3023f-cc78-418d-8336-8fa21df1b129 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:59.924437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c3d3023f-cc78-418d-8336-8fa21df1b129 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:59.924437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c3d3023f-cc78-418d-8336-8fa21df1b129 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:00.003306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-c3d3023f-cc78-418d-8336-8fa21df1b129 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:00.003958 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b5af98d4-0929-4747-bb08-92c789e27c0d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:00.026867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b5af98d4-0929-4747-bb08-92c789e27c0d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1367 microversion: 2.1 time: 0.244464 Jul 25 06:01:00.026867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 168/354] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:59 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:00.027021 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c3d3023f-cc78-418d-8336-8fa21df1b129 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1266 microversion: 2.1 time: 0.113337 Jul 25 06:01:00.027021 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 187/355] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:59 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:00.035075 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0b3534de-0e4c-4622-9be3-085146c052be tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:00.035937 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0b3534de-0e4c-4622-9be3-085146c052be tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:00.043159 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0b3534de-0e4c-4622-9be3-085146c052be tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:00.043827 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0b3534de-0e4c-4622-9be3-085146c052be tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:00.044746 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0b3534de-0e4c-4622-9be3-085146c052be tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:00.045336 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0b3534de-0e4c-4622-9be3-085146c052be tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:00.333001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-21e733a4-6009-4f44-b2cb-0580a32b0271 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:00.334866 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-21e733a4-6009-4f44-b2cb-0580a32b0271 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:00.346551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-21e733a4-6009-4f44-b2cb-0580a32b0271 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:00.352138 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-21e733a4-6009-4f44-b2cb-0580a32b0271 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:00.355990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-21e733a4-6009-4f44-b2cb-0580a32b0271 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:00.358233 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-21e733a4-6009-4f44-b2cb-0580a32b0271 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:00.601350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-21e733a4-6009-4f44-b2cb-0580a32b0271 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:00.611375 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-21e733a4-6009-4f44-b2cb-0580a32b0271 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1726 microversion: 2.1 time: 0.296242 Jul 25 06:01:00.614551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 188/356] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:00 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1726 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:00.618566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-78eaf47b-fae1-4669-9296-4c4585570bae tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:00.619203 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-78eaf47b-fae1-4669-9296-4c4585570bae tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:00.629071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-78eaf47b-fae1-4669-9296-4c4585570bae tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:00.629562 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-78eaf47b-fae1-4669-9296-4c4585570bae tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:00.633116 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-78eaf47b-fae1-4669-9296-4c4585570bae tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:00.633116 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-78eaf47b-fae1-4669-9296-4c4585570bae tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:00.637552 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:00.797838 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0b3534de-0e4c-4622-9be3-085146c052be tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:00.808802 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0b3534de-0e4c-4622-9be3-085146c052be tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:00.812972 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0b3534de-0e4c-4622-9be3-085146c052be tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:00.820721 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0b3534de-0e4c-4622-9be3-085146c052be tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1737 microversion: 2.20 time: 0.804117 Jul 25 06:01:00.821581 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 169/357] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:00 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1737 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:00.888425 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-78eaf47b-fae1-4669-9296-4c4585570bae tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:00.899686 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-78eaf47b-fae1-4669-9296-4c4585570bae tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.286160 Jul 25 06:01:00.910850 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 189/358] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:00 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1517 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:01.020880 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-6cf80092-64d2-4da5-8cfd-3bfd0513f03c req-cad6d86f-1ff3-4881-b4ee-ca7ab49fcdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "348f256d-41e5-47d8-b165-cad6dfcd0be9", "name": "network-vif-plugged", "status": "completed", "tag": "f9f7f9cc-3fd7-49f4-b8f2-59f247cf93e3"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:01.034392 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f03b124f-8738-48c1-895b-3c93062acd22 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:01.036654 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f03b124f-8738-48c1-895b-3c93062acd22 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:01.045974 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-6cf80092-64d2-4da5-8cfd-3bfd0513f03c req-cad6d86f-1ff3-4881-b4ee-ca7ab49fcdc4 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:01.046306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f03b124f-8738-48c1-895b-3c93062acd22 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:01.046817 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f03b124f-8738-48c1-895b-3c93062acd22 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:01.047493 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-6cf80092-64d2-4da5-8cfd-3bfd0513f03c req-cad6d86f-1ff3-4881-b4ee-ca7ab49fcdc4 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:01.047644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f03b124f-8738-48c1-895b-3c93062acd22 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:01.048013 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f03b124f-8738-48c1-895b-3c93062acd22 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:01.091509 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-6cf80092-64d2-4da5-8cfd-3bfd0513f03c req-cad6d86f-1ff3-4881-b4ee-ca7ab49fcdc4 service nova] Creating event network-vif-plugged:f9f7f9cc-3fd7-49f4-b8f2-59f247cf93e3 for instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 on hv-cinder-85083 Jul 25 06:01:01.118021 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-6cf80092-64d2-4da5-8cfd-3bfd0513f03c req-cad6d86f-1ff3-4881-b4ee-ca7ab49fcdc4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095240 Jul 25 06:01:01.119996 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 170/359] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:01.133344 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-26f58277-d16c-485b-a818-db31a2436d1b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:01.135682 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-26f58277-d16c-485b-a818-db31a2436d1b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:01.144706 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-26f58277-d16c-485b-a818-db31a2436d1b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:01.145285 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-26f58277-d16c-485b-a818-db31a2436d1b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:01.146152 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-26f58277-d16c-485b-a818-db31a2436d1b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:01.146685 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-26f58277-d16c-485b-a818-db31a2436d1b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:01.350056 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-26f58277-d16c-485b-a818-db31a2436d1b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:01.354118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:01.365497 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-26f58277-d16c-485b-a818-db31a2436d1b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1272 microversion: 2.1 time: 0.237095 Jul 25 06:01:01.375363 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 171/360] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:01 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:01.380922 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-489bdcd5-efa9-451b-b0b9-bfd5e49cc497 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9d6a6d5-8ea6-4ea6-9600-538940dcc72d", "device": "/dev/sdb"}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:01.382527 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-489bdcd5-efa9-451b-b0b9-bfd5e49cc497 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:01.390083 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-489bdcd5-efa9-451b-b0b9-bfd5e49cc497 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:01.390840 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-489bdcd5-efa9-451b-b0b9-bfd5e49cc497 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:01.391800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-489bdcd5-efa9-451b-b0b9-bfd5e49cc497 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:01.392393 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-489bdcd5-efa9-451b-b0b9-bfd5e49cc497 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:01.499656 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f03b124f-8738-48c1-895b-3c93062acd22 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:01.507104 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f03b124f-8738-48c1-895b-3c93062acd22 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1367 microversion: 2.1 time: 0.477722 Jul 25 06:01:01.512350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 190/361] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:01 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1367 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:01.630763 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-847f43d9-e9ab-44d3-b742-1851d8c3a7d8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:01.631429 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-847f43d9-e9ab-44d3-b742-1851d8c3a7d8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:01.641320 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-847f43d9-e9ab-44d3-b742-1851d8c3a7d8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:01.644971 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-847f43d9-e9ab-44d3-b742-1851d8c3a7d8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:01.664816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-847f43d9-e9ab-44d3-b742-1851d8c3a7d8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:01.665593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-847f43d9-e9ab-44d3-b742-1851d8c3a7d8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:02.388790 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-847f43d9-e9ab-44d3-b742-1851d8c3a7d8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:02.397691 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-847f43d9-e9ab-44d3-b742-1851d8c3a7d8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1726 microversion: 2.1 time: 0.772257 Jul 25 06:01:02.399020 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 191/362] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:01 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1726 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:02.404623 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-df7dec94-3a73-4171-a6aa-a80d14254885 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:02.405568 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-df7dec94-3a73-4171-a6aa-a80d14254885 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:02.413448 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-df7dec94-3a73-4171-a6aa-a80d14254885 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:02.414358 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-df7dec94-3a73-4171-a6aa-a80d14254885 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:02.415407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-df7dec94-3a73-4171-a6aa-a80d14254885 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:02.416110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-df7dec94-3a73-4171-a6aa-a80d14254885 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:02.574413 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-df7dec94-3a73-4171-a6aa-a80d14254885 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:02.584097 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-df7dec94-3a73-4171-a6aa-a80d14254885 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:02.585666 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-df7dec94-3a73-4171-a6aa-a80d14254885 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:02.586884 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-df7dec94-3a73-4171-a6aa-a80d14254885 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1737 microversion: 2.20 time: 0.186641 Jul 25 06:01:02.598536 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 192/363] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:02 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:02.598536 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3c1013f1-79a3-4cea-acbe-358ac64114bf tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:02.598536 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-3c1013f1-79a3-4cea-acbe-358ac64114bf tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:02.607596 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3c1013f1-79a3-4cea-acbe-358ac64114bf tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:02.608213 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3c1013f1-79a3-4cea-acbe-358ac64114bf tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:02.609098 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3c1013f1-79a3-4cea-acbe-358ac64114bf tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:02.609729 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3c1013f1-79a3-4cea-acbe-358ac64114bf tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:02.681461 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3c1013f1-79a3-4cea-acbe-358ac64114bf tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:02.690202 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-3c1013f1-79a3-4cea-acbe-358ac64114bf tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1272 microversion: 2.1 time: 0.101055 Jul 25 06:01:02.700224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 193/364] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:02 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1272 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:02.700224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-88d5be30-d001-4ee2-92f0-dc6b6215e07c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:02.700224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-88d5be30-d001-4ee2-92f0-dc6b6215e07c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:02.702056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-88d5be30-d001-4ee2-92f0-dc6b6215e07c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:02.702572 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-88d5be30-d001-4ee2-92f0-dc6b6215e07c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:02.703407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-88d5be30-d001-4ee2-92f0-dc6b6215e07c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:02.703844 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-88d5be30-d001-4ee2-92f0-dc6b6215e07c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:02.871870 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-88d5be30-d001-4ee2-92f0-dc6b6215e07c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:02.881030 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-88d5be30-d001-4ee2-92f0-dc6b6215e07c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1367 microversion: 2.1 time: 0.189124 Jul 25 06:01:02.881452 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 194/365] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:02 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:03.023956 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-489bdcd5-efa9-451b-b0b9-bfd5e49cc497 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "POST /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.646836 Jul 25 06:01:03.026198 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 172/366] 10.222.0.17 () {60 vars in 1322 bytes} [Mon Jul 25 06:01:01 2022] POST /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c/os-volume_attachments => generated 194 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:03.416694 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e30fa5cb-0203-4eae-92a8-081e9bd9ac34 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:03.418047 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e30fa5cb-0203-4eae-92a8-081e9bd9ac34 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:03.431122 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e30fa5cb-0203-4eae-92a8-081e9bd9ac34 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:03.431964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e30fa5cb-0203-4eae-92a8-081e9bd9ac34 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:03.432956 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e30fa5cb-0203-4eae-92a8-081e9bd9ac34 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:03.434447 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e30fa5cb-0203-4eae-92a8-081e9bd9ac34 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:03.607308 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-5df66473-9951-4ac1-bf1b-f063c6901a4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:03.611037 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-5df66473-9951-4ac1-bf1b-f063c6901a4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:03.625218 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5df66473-9951-4ac1-bf1b-f063c6901a4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:03.625674 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5df66473-9951-4ac1-bf1b-f063c6901a4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:03.627944 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5df66473-9951-4ac1-bf1b-f063c6901a4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:03.631155 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5df66473-9951-4ac1-bf1b-f063c6901a4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:03.681133 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e30fa5cb-0203-4eae-92a8-081e9bd9ac34 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:03.691153 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e30fa5cb-0203-4eae-92a8-081e9bd9ac34 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1726 microversion: 2.1 time: 0.279314 Jul 25 06:01:03.692397 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 195/367] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:03 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1726 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:03.708233 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-117be883-d2b7-478a-b465-a073a0d691a0 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:03.709766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-117be883-d2b7-478a-b465-a073a0d691a0 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:03.721656 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-117be883-d2b7-478a-b465-a073a0d691a0 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:03.723591 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-117be883-d2b7-478a-b465-a073a0d691a0 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:03.725795 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-117be883-d2b7-478a-b465-a073a0d691a0 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:03.727001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-117be883-d2b7-478a-b465-a073a0d691a0 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:03.920860 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5df66473-9951-4ac1-bf1b-f063c6901a4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:03.937309 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5df66473-9951-4ac1-bf1b-f063c6901a4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:03.939019 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5df66473-9951-4ac1-bf1b-f063c6901a4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:03.940415 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-5df66473-9951-4ac1-bf1b-f063c6901a4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1737 microversion: 2.20 time: 0.338055 Jul 25 06:01:03.964972 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-117be883-d2b7-478a-b465-a073a0d691a0 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:03.973198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-117be883-d2b7-478a-b465-a073a0d691a0 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1314 microversion: 2.1 time: 0.269284 Jul 25 06:01:03.975694 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 173/368] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:03 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1737 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:01:03.976982 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 196/369] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:03 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:03.991132 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e27df529-3b10-4ab1-8f5d-94b51137628b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:03.993661 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e27df529-3b10-4ab1-8f5d-94b51137628b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:04.000757 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e27df529-3b10-4ab1-8f5d-94b51137628b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:04.001454 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e27df529-3b10-4ab1-8f5d-94b51137628b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:04.002509 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e27df529-3b10-4ab1-8f5d-94b51137628b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:04.003252 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e27df529-3b10-4ab1-8f5d-94b51137628b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:04.282080 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e27df529-3b10-4ab1-8f5d-94b51137628b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:04.290569 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e27df529-3b10-4ab1-8f5d-94b51137628b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1367 microversion: 2.1 time: 0.312486 Jul 25 06:01:04.292363 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 174/370] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:03 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:04.468570 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-776eb6b3-5dc9-4236-861c-8801fbc1ffd5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Action: 'create', calling method: .version_select at 0x7f9d3620c160>, body: {"keypair": {"name": "tempest-keypair-1289705386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0dHHeCMlB4czTPCSfUfyh/SioDtnzp0mh3LqBe1ZCBxz1IlP7kj7G3mg+qKDvtS5kdYwV7mI7cmp3Tig35/468kz/jB8TAwF+ASNHYZoGITrt9OwtV6RFFtM0ew+zRqQ=="}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:04.538629 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-776eb6b3-5dc9-4236-861c-8801fbc1ffd5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Getting quotas for project d30518907b9f4939b1e8666eba12186e. Resources: {'key_pairs'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:01:04.551073 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-776eb6b3-5dc9-4236-861c-8801fbc1ffd5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Getting quotas for user 13e5d648af294c7cbc86ccd362914728 and project d30518907b9f4939b1e8666eba12186e. Resources: {'key_pairs'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:01:04.671839 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-776eb6b3-5dc9-4236-861c-8801fbc1ffd5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.217374 Jul 25 06:01:04.672472 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 197/371] 10.222.0.17 () {60 vars in 1158 bytes} [Mon Jul 25 06:01:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:04.709914 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f9a7cf69-4d1c-4711-9bd7-cab8997c6b51 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:04.710597 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f9a7cf69-4d1c-4711-9bd7-cab8997c6b51 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:04.728886 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f9a7cf69-4d1c-4711-9bd7-cab8997c6b51 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:04.729644 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f9a7cf69-4d1c-4711-9bd7-cab8997c6b51 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:04.730422 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f9a7cf69-4d1c-4711-9bd7-cab8997c6b51 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:04.732902 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f9a7cf69-4d1c-4711-9bd7-cab8997c6b51 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:04.960206 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7cad31f3-8012-4096-8eac-f1aafafc5129 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:04.961617 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7cad31f3-8012-4096-8eac-f1aafafc5129 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:04.971876 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-f9a7cf69-4d1c-4711-9bd7-cab8997c6b51 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:04.985323 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7cad31f3-8012-4096-8eac-f1aafafc5129 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:04.985773 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7cad31f3-8012-4096-8eac-f1aafafc5129 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:04.987976 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7cad31f3-8012-4096-8eac-f1aafafc5129 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:04.987976 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7cad31f3-8012-4096-8eac-f1aafafc5129 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:04.988172 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f9a7cf69-4d1c-4711-9bd7-cab8997c6b51 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1726 microversion: 2.1 time: 0.281742 Jul 25 06:01:04.990974 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 175/372] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:04 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1726 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:05.002293 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-7e8e2bfc-4f73-4026-bbd3-f3b934ed4a05 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:05.006231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-7e8e2bfc-4f73-4026-bbd3-f3b934ed4a05 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:05.035632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7e8e2bfc-4f73-4026-bbd3-f3b934ed4a05 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:05.036194 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7e8e2bfc-4f73-4026-bbd3-f3b934ed4a05 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:05.039647 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7e8e2bfc-4f73-4026-bbd3-f3b934ed4a05 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:05.057160 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7e8e2bfc-4f73-4026-bbd3-f3b934ed4a05 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:05.225951 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7cad31f3-8012-4096-8eac-f1aafafc5129 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:05.235142 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7cad31f3-8012-4096-8eac-f1aafafc5129 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:05.236687 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7cad31f3-8012-4096-8eac-f1aafafc5129 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:05.238160 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-7cad31f3-8012-4096-8eac-f1aafafc5129 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1737 microversion: 2.20 time: 0.282650 Jul 25 06:01:05.238742 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 198/373] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:04 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1737 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:05.270536 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-7e8e2bfc-4f73-4026-bbd3-f3b934ed4a05 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:05.278506 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-7e8e2bfc-4f73-4026-bbd3-f3b934ed4a05 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1314 microversion: 2.1 time: 0.286499 Jul 25 06:01:05.279061 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 176/374] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:04 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:05.308960 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3cf5286a-7619-4340-90af-cc0a63d6ec59 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:05.309737 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-3cf5286a-7619-4340-90af-cc0a63d6ec59 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:05.316920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3cf5286a-7619-4340-90af-cc0a63d6ec59 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:05.317574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3cf5286a-7619-4340-90af-cc0a63d6ec59 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:05.318356 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3cf5286a-7619-4340-90af-cc0a63d6ec59 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:05.318840 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3cf5286a-7619-4340-90af-cc0a63d6ec59 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:05.459252 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3cf5286a-7619-4340-90af-cc0a63d6ec59 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:05.466690 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-3cf5286a-7619-4340-90af-cc0a63d6ec59 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1367 microversion: 2.1 time: 0.161682 Jul 25 06:01:05.467260 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 199/375] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:05 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:05.653196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-610a233f-203d-4e10-8954-80305b3b61f8 req-4bb9390c-331e-443f-8e67-2741ed921cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b34891-1621-4f3a-9da2-a76876d73d9d", "tag": "6eaf0f0d-7dd9-4355-b116-4148ed1c86ec"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:05.663766 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-610a233f-203d-4e10-8954-80305b3b61f8 req-4bb9390c-331e-443f-8e67-2741ed921cb2 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:05.664218 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-610a233f-203d-4e10-8954-80305b3b61f8 req-4bb9390c-331e-443f-8e67-2741ed921cb2 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:05.685750 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-610a233f-203d-4e10-8954-80305b3b61f8 req-4bb9390c-331e-443f-8e67-2741ed921cb2 service nova] Creating event network-changed:6eaf0f0d-7dd9-4355-b116-4148ed1c86ec for instance 57b34891-1621-4f3a-9da2-a76876d73d9d on hv-cinder-85083 Jul 25 06:01:05.690787 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-610a233f-203d-4e10-8954-80305b3b61f8 req-4bb9390c-331e-443f-8e67-2741ed921cb2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042713 Jul 25 06:01:05.691383 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 177/376] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:06.005990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-0ff65774-eefb-49aa-88df-450e269450a9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:06.006658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-0ff65774-eefb-49aa-88df-450e269450a9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:06.008559 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=4 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:06.017809 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0ff65774-eefb-49aa-88df-450e269450a9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:06.018267 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0ff65774-eefb-49aa-88df-450e269450a9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:06.019088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0ff65774-eefb-49aa-88df-450e269450a9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:06.019527 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0ff65774-eefb-49aa-88df-450e269450a9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:06.242201 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-0ff65774-eefb-49aa-88df-450e269450a9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:06.261008 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-30d92efa-d806-4b02-98d7-6a052b3353ce tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:06.262051 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-30d92efa-d806-4b02-98d7-6a052b3353ce tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:06.268219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-0ff65774-eefb-49aa-88df-450e269450a9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1726 microversion: 2.1 time: 0.266047 Jul 25 06:01:06.274252 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-30d92efa-d806-4b02-98d7-6a052b3353ce tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:06.274627 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 200/377] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:06 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1726 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:06.275136 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-30d92efa-d806-4b02-98d7-6a052b3353ce tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:06.275986 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-30d92efa-d806-4b02-98d7-6a052b3353ce tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:06.276494 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-30d92efa-d806-4b02-98d7-6a052b3353ce tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:06.299010 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-42287d1b-bfa0-4534-b24f-fe07e6c45b6e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:06.299010 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-42287d1b-bfa0-4534-b24f-fe07e6c45b6e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:06.307475 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-42287d1b-bfa0-4534-b24f-fe07e6c45b6e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:06.310188 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-42287d1b-bfa0-4534-b24f-fe07e6c45b6e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:06.312337 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-42287d1b-bfa0-4534-b24f-fe07e6c45b6e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:06.314458 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-42287d1b-bfa0-4534-b24f-fe07e6c45b6e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:06.543892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-42287d1b-bfa0-4534-b24f-fe07e6c45b6e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:06.560509 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-42287d1b-bfa0-4534-b24f-fe07e6c45b6e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1314 microversion: 2.1 time: 0.261639 Jul 25 06:01:06.562000 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 201/378] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:06 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:06.567238 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-887f10c1-bdb2-4826-895d-a14f05e05bc2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:06.568462 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-887f10c1-bdb2-4826-895d-a14f05e05bc2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:06.575066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-887f10c1-bdb2-4826-895d-a14f05e05bc2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:06.575567 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-887f10c1-bdb2-4826-895d-a14f05e05bc2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:06.576403 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-887f10c1-bdb2-4826-895d-a14f05e05bc2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:06.577049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-887f10c1-bdb2-4826-895d-a14f05e05bc2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:06.618073 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-30d92efa-d806-4b02-98d7-6a052b3353ce tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:06.631335 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-30d92efa-d806-4b02-98d7-6a052b3353ce tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:06.639997 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-30d92efa-d806-4b02-98d7-6a052b3353ce tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:06.641912 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-30d92efa-d806-4b02-98d7-6a052b3353ce tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1737 microversion: 2.20 time: 0.389053 Jul 25 06:01:06.643406 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 178/379] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:06 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1737 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:06.868518 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-887f10c1-bdb2-4826-895d-a14f05e05bc2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:06.876883 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-887f10c1-bdb2-4826-895d-a14f05e05bc2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1367 microversion: 2.1 time: 0.313441 Jul 25 06:01:06.877736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 202/380] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:06 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:07.290344 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-21e7b5d8-fb2d-41d9-9d06-fa5f5bad9829 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:07.291508 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-21e7b5d8-fb2d-41d9-9d06-fa5f5bad9829 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:07.298345 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-21e7b5d8-fb2d-41d9-9d06-fa5f5bad9829 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:07.299627 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-21e7b5d8-fb2d-41d9-9d06-fa5f5bad9829 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:07.304374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-21e7b5d8-fb2d-41d9-9d06-fa5f5bad9829 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:07.304374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-21e7b5d8-fb2d-41d9-9d06-fa5f5bad9829 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:07.534550 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-21e7b5d8-fb2d-41d9-9d06-fa5f5bad9829 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:07.550496 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-21e7b5d8-fb2d-41d9-9d06-fa5f5bad9829 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1726 microversion: 2.1 time: 0.267621 Jul 25 06:01:07.554837 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 179/381] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:07 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1726 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:07.579299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-236cebe0-e275-49da-a953-a15c7262f31b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:07.580635 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-236cebe0-e275-49da-a953-a15c7262f31b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:07.592351 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-236cebe0-e275-49da-a953-a15c7262f31b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:07.593057 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-236cebe0-e275-49da-a953-a15c7262f31b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:07.594317 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-236cebe0-e275-49da-a953-a15c7262f31b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:07.596617 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-236cebe0-e275-49da-a953-a15c7262f31b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:07.661819 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-927312f2-d73d-40b1-900d-f9f1af461369 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:07.663116 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-927312f2-d73d-40b1-900d-f9f1af461369 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:07.672967 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-927312f2-d73d-40b1-900d-f9f1af461369 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:07.673809 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-927312f2-d73d-40b1-900d-f9f1af461369 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:07.674843 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-927312f2-d73d-40b1-900d-f9f1af461369 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:07.675498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-927312f2-d73d-40b1-900d-f9f1af461369 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:07.744732 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=4 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:07.875418 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-236cebe0-e275-49da-a953-a15c7262f31b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:07.886064 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-236cebe0-e275-49da-a953-a15c7262f31b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1314 microversion: 2.1 time: 0.310455 Jul 25 06:01:07.886720 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 203/382] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:07 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:07.919454 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5cff643b-096c-45a9-8518-2f1a67b30c27 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:07.919454 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5cff643b-096c-45a9-8518-2f1a67b30c27 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:07.934072 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5cff643b-096c-45a9-8518-2f1a67b30c27 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:07.935024 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5cff643b-096c-45a9-8518-2f1a67b30c27 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:07.936283 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5cff643b-096c-45a9-8518-2f1a67b30c27 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:07.936901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5cff643b-096c-45a9-8518-2f1a67b30c27 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:08.068515 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-927312f2-d73d-40b1-900d-f9f1af461369 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:08.084263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-927312f2-d73d-40b1-900d-f9f1af461369 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:08.086206 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-927312f2-d73d-40b1-900d-f9f1af461369 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:08.087561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-927312f2-d73d-40b1-900d-f9f1af461369 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1737 microversion: 2.20 time: 0.430095 Jul 25 06:01:08.088471 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 180/383] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:07 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1737 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:01:08.118254 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5cff643b-096c-45a9-8518-2f1a67b30c27 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:08.129546 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5cff643b-096c-45a9-8518-2f1a67b30c27 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1367 microversion: 2.1 time: 0.224897 Jul 25 06:01:08.130161 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 204/384] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:07 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:08.573232 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-66942e42-155b-4923-99c3-18172bf4ee09 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:08.574294 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-66942e42-155b-4923-99c3-18172bf4ee09 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:08.582664 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-66942e42-155b-4923-99c3-18172bf4ee09 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:08.583289 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-66942e42-155b-4923-99c3-18172bf4ee09 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:08.584266 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-66942e42-155b-4923-99c3-18172bf4ee09 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:08.585099 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-66942e42-155b-4923-99c3-18172bf4ee09 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:08.717410 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-294a38af-4962-4af7-8b9f-2728368d76bb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1763782187", "imageRef": "bfffd6ef-7f99-4a99-90f3-027fe9c89821", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b267e454-5603-4afc-b3f7-189ef5d55d73"}], "security_groups": [{"name": "tempest-securitygroup--1483865097"}], "key_name": "tempest-keypair-1289705386", "user_data": "}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:08.776285 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-66942e42-155b-4923-99c3-18172bf4ee09 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:08.787606 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-66942e42-155b-4923-99c3-18172bf4ee09 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1726 microversion: 2.1 time: 0.220575 Jul 25 06:01:08.798759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 181/385] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:08 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1726 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:08.904549 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e8ceff01-8e05-427f-98be-b0099e3a5420 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:08.905484 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e8ceff01-8e05-427f-98be-b0099e3a5420 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:08.920802 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e8ceff01-8e05-427f-98be-b0099e3a5420 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:08.922862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e8ceff01-8e05-427f-98be-b0099e3a5420 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:08.926635 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e8ceff01-8e05-427f-98be-b0099e3a5420 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:08.928226 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e8ceff01-8e05-427f-98be-b0099e3a5420 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:09.269861 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e8ceff01-8e05-427f-98be-b0099e3a5420 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:09.321530 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e8ceff01-8e05-427f-98be-b0099e3a5420 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1314 microversion: 2.1 time: 0.403045 Jul 25 06:01:09.321530 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 182/386] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:08 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:09.389513 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-41282ce3-6427-4837-bdda-f9eb0340ae20 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:09.390128 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-41282ce3-6427-4837-bdda-f9eb0340ae20 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:09.397598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-41282ce3-6427-4837-bdda-f9eb0340ae20 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:09.399516 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-41282ce3-6427-4837-bdda-f9eb0340ae20 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:09.400624 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-41282ce3-6427-4837-bdda-f9eb0340ae20 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:09.401324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-41282ce3-6427-4837-bdda-f9eb0340ae20 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:09.566256 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-41282ce3-6427-4837-bdda-f9eb0340ae20 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:09.574665 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-41282ce3-6427-4837-bdda-f9eb0340ae20 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:09.576204 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-41282ce3-6427-4837-bdda-f9eb0340ae20 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:09.584022 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-41282ce3-6427-4837-bdda-f9eb0340ae20 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1737 microversion: 2.20 time: 0.212495 Jul 25 06:01:09.584022 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 183/387] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:09 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1737 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:09.587755 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-77b92e2e-915d-4628-9d4b-3004798e999e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:09.588495 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-77b92e2e-915d-4628-9d4b-3004798e999e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:09.594701 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-77b92e2e-915d-4628-9d4b-3004798e999e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:09.595141 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-77b92e2e-915d-4628-9d4b-3004798e999e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:09.595893 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-77b92e2e-915d-4628-9d4b-3004798e999e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:09.596320 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-77b92e2e-915d-4628-9d4b-3004798e999e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:09.758298 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-77b92e2e-915d-4628-9d4b-3004798e999e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:09.767304 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-77b92e2e-915d-4628-9d4b-3004798e999e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1367 microversion: 2.1 time: 0.188126 Jul 25 06:01:09.768078 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 184/388] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:09 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:09.772867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-db2081cc-9cde-4fdb-a341-1b79e494f7fd req-a677ff40-0f51-43eb-beeb-e18534b4c707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb485129-6941-49db-9cee-c83f53f2bdff", "name": "network-vif-plugged", "status": "completed", "tag": "08aafc3d-895b-4cc7-84fd-174d4858268a"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:09.785704 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-db2081cc-9cde-4fdb-a341-1b79e494f7fd req-a677ff40-0f51-43eb-beeb-e18534b4c707 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:09.785704 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-db2081cc-9cde-4fdb-a341-1b79e494f7fd req-a677ff40-0f51-43eb-beeb-e18534b4c707 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:09.793492 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-db2081cc-9cde-4fdb-a341-1b79e494f7fd req-a677ff40-0f51-43eb-beeb-e18534b4c707 service nova] Creating event network-vif-plugged:08aafc3d-895b-4cc7-84fd-174d4858268a for instance fb485129-6941-49db-9cee-c83f53f2bdff on hv-cinder-85083 Jul 25 06:01:09.798186 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-db2081cc-9cde-4fdb-a341-1b79e494f7fd req-a677ff40-0f51-43eb-beeb-e18534b4c707 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028968 Jul 25 06:01:09.799036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 185/389] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:09.807162 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-fb24c463-43b9-43c9-98b5-53faf197f4f4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:09.809067 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-fb24c463-43b9-43c9-98b5-53faf197f4f4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:09.816001 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fb24c463-43b9-43c9-98b5-53faf197f4f4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:09.817159 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fb24c463-43b9-43c9-98b5-53faf197f4f4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:09.818553 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fb24c463-43b9-43c9-98b5-53faf197f4f4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:09.819059 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fb24c463-43b9-43c9-98b5-53faf197f4f4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:10.031485 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-fb24c463-43b9-43c9-98b5-53faf197f4f4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:10.044476 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-fb24c463-43b9-43c9-98b5-53faf197f4f4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1726 microversion: 2.1 time: 0.240841 Jul 25 06:01:10.045087 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 186/390] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:09 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1726 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:10.349337 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-232f736b-9d70-4051-886e-047dfd3755b7 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:10.350282 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-232f736b-9d70-4051-886e-047dfd3755b7 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:10.362431 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-232f736b-9d70-4051-886e-047dfd3755b7 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:10.362924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-232f736b-9d70-4051-886e-047dfd3755b7 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:10.363747 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-232f736b-9d70-4051-886e-047dfd3755b7 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:10.367000 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-232f736b-9d70-4051-886e-047dfd3755b7 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:10.759113 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-232f736b-9d70-4051-886e-047dfd3755b7 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:10.774713 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-232f736b-9d70-4051-886e-047dfd3755b7 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1314 microversion: 2.1 time: 0.425765 Jul 25 06:01:10.774713 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 187/391] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:10 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:10.785038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8fc341fe-cb92-4d66-9ae8-0cd285afae4b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:10.785654 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8fc341fe-cb92-4d66-9ae8-0cd285afae4b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:10.793249 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8fc341fe-cb92-4d66-9ae8-0cd285afae4b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:10.797452 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8fc341fe-cb92-4d66-9ae8-0cd285afae4b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:10.797452 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8fc341fe-cb92-4d66-9ae8-0cd285afae4b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:10.797452 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8fc341fe-cb92-4d66-9ae8-0cd285afae4b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:10.814685 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:10.988883 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8fc341fe-cb92-4d66-9ae8-0cd285afae4b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:10.999650 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8fc341fe-cb92-4d66-9ae8-0cd285afae4b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:11.001655 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8fc341fe-cb92-4d66-9ae8-0cd285afae4b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:11.007424 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-8fc341fe-cb92-4d66-9ae8-0cd285afae4b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1737 microversion: 2.20 time: 0.236001 Jul 25 06:01:11.008294 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 188/392] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:10 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:11.041301 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-37c5fba6-786a-4e50-972e-8046f4c211ed tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:11.048979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-37c5fba6-786a-4e50-972e-8046f4c211ed tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:11.065790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-37c5fba6-786a-4e50-972e-8046f4c211ed tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:11.066257 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-37c5fba6-786a-4e50-972e-8046f4c211ed tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:11.069943 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-37c5fba6-786a-4e50-972e-8046f4c211ed tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:11.069943 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-37c5fba6-786a-4e50-972e-8046f4c211ed tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:11.275077 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-37c5fba6-786a-4e50-972e-8046f4c211ed tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:11.286896 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-37c5fba6-786a-4e50-972e-8046f4c211ed tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1367 microversion: 2.1 time: 0.263106 Jul 25 06:01:11.287512 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 189/393] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:11 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:11.300025 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a9fd94ac-4d8e-4f3d-9617-febd2500cf50 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:11.300961 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a9fd94ac-4d8e-4f3d-9617-febd2500cf50 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:11.316483 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a9fd94ac-4d8e-4f3d-9617-febd2500cf50 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:11.318543 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a9fd94ac-4d8e-4f3d-9617-febd2500cf50 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:11.318543 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a9fd94ac-4d8e-4f3d-9617-febd2500cf50 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:11.318543 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a9fd94ac-4d8e-4f3d-9617-febd2500cf50 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:11.539999 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-a9fd94ac-4d8e-4f3d-9617-febd2500cf50 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:11.558773 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a9fd94ac-4d8e-4f3d-9617-febd2500cf50 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1703 microversion: 2.1 time: 0.260607 Jul 25 06:01:11.560203 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 190/394] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:11 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1703 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:11.582904 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-396f7284-1191-4e14-a7ea-6d58ed6fe749 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:11.597418 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-396f7284-1191-4e14-a7ea-6d58ed6fe749 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:11.602621 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-396f7284-1191-4e14-a7ea-6d58ed6fe749 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:11.629861 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-396f7284-1191-4e14-a7ea-6d58ed6fe749 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Going to try to start instance {{(pid=130162) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 06:01:11.921641 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-396f7284-1191-4e14-a7ea-6d58ed6fe749 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "POST /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/action" status: 202 len: 0 microversion: 2.1 time: 0.343635 Jul 25 06:01:11.923233 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 191/395] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 06:01:11 2022] POST /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:01:11.939592 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cec00123-6b79-4f53-b19a-b1ad6515c175 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:11.945691 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-cec00123-6b79-4f53-b19a-b1ad6515c175 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:11.954427 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cec00123-6b79-4f53-b19a-b1ad6515c175 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:11.957302 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cec00123-6b79-4f53-b19a-b1ad6515c175 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:11.965273 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cec00123-6b79-4f53-b19a-b1ad6515c175 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:11.965827 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cec00123-6b79-4f53-b19a-b1ad6515c175 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:12.179248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cec00123-6b79-4f53-b19a-b1ad6515c175 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:12.190267 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-cec00123-6b79-4f53-b19a-b1ad6515c175 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1314 microversion: 2.1 time: 0.265749 Jul 25 06:01:12.198545 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 192/396] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:11 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:12.198545 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a3e967c3-1be2-4945-abb8-b860a83ade2f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:12.198545 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a3e967c3-1be2-4945-abb8-b860a83ade2f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:12.212135 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a3e967c3-1be2-4945-abb8-b860a83ade2f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:12.213641 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a3e967c3-1be2-4945-abb8-b860a83ade2f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:12.214446 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a3e967c3-1be2-4945-abb8-b860a83ade2f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:12.214920 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a3e967c3-1be2-4945-abb8-b860a83ade2f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:12.424667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-a3e967c3-1be2-4945-abb8-b860a83ade2f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:12.434530 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a3e967c3-1be2-4945-abb8-b860a83ade2f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1712 microversion: 2.1 time: 0.242179 Jul 25 06:01:12.446277 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 193/397] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:12 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1712 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:12.455931 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1199cf3b-ce43-4459-9a2f-4aff24246e5a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:12.456691 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1199cf3b-ce43-4459-9a2f-4aff24246e5a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:12.463755 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1199cf3b-ce43-4459-9a2f-4aff24246e5a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:12.464206 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1199cf3b-ce43-4459-9a2f-4aff24246e5a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:12.465045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1199cf3b-ce43-4459-9a2f-4aff24246e5a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:12.465530 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1199cf3b-ce43-4459-9a2f-4aff24246e5a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:12.672980 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1199cf3b-ce43-4459-9a2f-4aff24246e5a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:12.685555 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1199cf3b-ce43-4459-9a2f-4aff24246e5a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:12.693821 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1199cf3b-ce43-4459-9a2f-4aff24246e5a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:12.695390 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1199cf3b-ce43-4459-9a2f-4aff24246e5a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1737 microversion: 2.20 time: 0.248053 Jul 25 06:01:12.705889 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 194/398] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:12 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1737 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:12.705889 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1725c32e-3f21-40d0-baf5-802c7ea04329 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:12.705889 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1725c32e-3f21-40d0-baf5-802c7ea04329 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:12.712324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1725c32e-3f21-40d0-baf5-802c7ea04329 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:12.717038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1725c32e-3f21-40d0-baf5-802c7ea04329 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:12.717038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1725c32e-3f21-40d0-baf5-802c7ea04329 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:12.717038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1725c32e-3f21-40d0-baf5-802c7ea04329 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:12.923303 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1725c32e-3f21-40d0-baf5-802c7ea04329 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:12.931935 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1725c32e-3f21-40d0-baf5-802c7ea04329 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1367 microversion: 2.1 time: 0.234390 Jul 25 06:01:12.936490 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 195/399] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:12 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:13.217897 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ef9389dd-d384-47cc-b551-7069c1edf9e1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:13.246540 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ef9389dd-d384-47cc-b551-7069c1edf9e1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:13.255658 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ef9389dd-d384-47cc-b551-7069c1edf9e1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:13.256108 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ef9389dd-d384-47cc-b551-7069c1edf9e1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:13.269296 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ef9389dd-d384-47cc-b551-7069c1edf9e1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:13.273961 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ef9389dd-d384-47cc-b551-7069c1edf9e1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:13.492578 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ef9389dd-d384-47cc-b551-7069c1edf9e1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:13.500068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ef9389dd-d384-47cc-b551-7069c1edf9e1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1314 microversion: 2.1 time: 0.289619 Jul 25 06:01:13.500664 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 196/400] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:13 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:13.507532 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9a701d29-e76e-43a9-b6c7-38203dd56ff2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:13.508838 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-9a701d29-e76e-43a9-b6c7-38203dd56ff2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:13.514901 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9a701d29-e76e-43a9-b6c7-38203dd56ff2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:13.515336 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9a701d29-e76e-43a9-b6c7-38203dd56ff2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:13.516089 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9a701d29-e76e-43a9-b6c7-38203dd56ff2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:13.516515 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9a701d29-e76e-43a9-b6c7-38203dd56ff2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:13.676170 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-9a701d29-e76e-43a9-b6c7-38203dd56ff2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:13.684535 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-9a701d29-e76e-43a9-b6c7-38203dd56ff2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1712 microversion: 2.1 time: 0.182914 Jul 25 06:01:13.685110 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 197/401] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:13 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1712 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:13.713333 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-319722a6-7128-4be8-b39e-f0d70ab16ff2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:13.714102 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-319722a6-7128-4be8-b39e-f0d70ab16ff2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:13.739820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-319722a6-7128-4be8-b39e-f0d70ab16ff2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:13.740555 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-319722a6-7128-4be8-b39e-f0d70ab16ff2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:13.741614 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-319722a6-7128-4be8-b39e-f0d70ab16ff2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:13.742143 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-319722a6-7128-4be8-b39e-f0d70ab16ff2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:13.979829 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-319722a6-7128-4be8-b39e-f0d70ab16ff2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:13.990449 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-319722a6-7128-4be8-b39e-f0d70ab16ff2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:13.991988 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-319722a6-7128-4be8-b39e-f0d70ab16ff2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:13.993186 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-319722a6-7128-4be8-b39e-f0d70ab16ff2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1737 microversion: 2.20 time: 0.283886 Jul 25 06:01:13.993784 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 198/402] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:13 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1737 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:01:13.998290 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-4777608f-93ea-46ab-b8c7-8b536bd3681c req-86eb3929-48ef-4150-ac24-23bc05c6e3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b34891-1621-4f3a-9da2-a76876d73d9d", "name": "network-vif-plugged", "status": "completed", "tag": "6eaf0f0d-7dd9-4355-b116-4148ed1c86ec"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:14.006442 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-4777608f-93ea-46ab-b8c7-8b536bd3681c req-86eb3929-48ef-4150-ac24-23bc05c6e3da service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:14.006941 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-4777608f-93ea-46ab-b8c7-8b536bd3681c req-86eb3929-48ef-4150-ac24-23bc05c6e3da service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:14.018670 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-4777608f-93ea-46ab-b8c7-8b536bd3681c req-86eb3929-48ef-4150-ac24-23bc05c6e3da service nova] Creating event network-vif-plugged:6eaf0f0d-7dd9-4355-b116-4148ed1c86ec for instance 57b34891-1621-4f3a-9da2-a76876d73d9d on hv-cinder-85083 Jul 25 06:01:14.024045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-4777608f-93ea-46ab-b8c7-8b536bd3681c req-86eb3929-48ef-4150-ac24-23bc05c6e3da service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029082 Jul 25 06:01:14.024854 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 199/403] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:14.032066 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cb503b58-340d-4334-8779-cb5f9f808b38 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:14.033004 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-cb503b58-340d-4334-8779-cb5f9f808b38 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:14.040456 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cb503b58-340d-4334-8779-cb5f9f808b38 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:14.040898 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cb503b58-340d-4334-8779-cb5f9f808b38 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:14.041806 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cb503b58-340d-4334-8779-cb5f9f808b38 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:14.042623 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cb503b58-340d-4334-8779-cb5f9f808b38 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:14.331275 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cb503b58-340d-4334-8779-cb5f9f808b38 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:14.339805 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-cb503b58-340d-4334-8779-cb5f9f808b38 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1556 microversion: 2.1 time: 0.312075 Jul 25 06:01:14.353980 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 200/404] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:14 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1556 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:14.365649 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-534b130a-3ac1-43ba-9ad7-d7798908a638 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:14.366804 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-534b130a-3ac1-43ba-9ad7-d7798908a638 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:14.373459 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-534b130a-3ac1-43ba-9ad7-d7798908a638 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:14.374265 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-534b130a-3ac1-43ba-9ad7-d7798908a638 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:14.375844 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-534b130a-3ac1-43ba-9ad7-d7798908a638 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:14.376646 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-534b130a-3ac1-43ba-9ad7-d7798908a638 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:14.575814 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=20 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:14.717310 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-534b130a-3ac1-43ba-9ad7-d7798908a638 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.356506 Jul 25 06:01:14.732744 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 201/405] 10.222.0.17 () {58 vars in 1274 bytes} [Mon Jul 25 06:01:14 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff/os-interface => generated 285 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:14.762932 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-7de1d360-4874-438d-a721-6f12bac1d5a5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:14.766836 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-7de1d360-4874-438d-a721-6f12bac1d5a5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:14.783012 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7de1d360-4874-438d-a721-6f12bac1d5a5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:14.784591 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7de1d360-4874-438d-a721-6f12bac1d5a5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:14.785622 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7de1d360-4874-438d-a721-6f12bac1d5a5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:14.786693 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7de1d360-4874-438d-a721-6f12bac1d5a5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:14.950788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-7de1d360-4874-438d-a721-6f12bac1d5a5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:14.959187 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-7de1d360-4874-438d-a721-6f12bac1d5a5 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1314 microversion: 2.1 time: 0.225319 Jul 25 06:01:14.959849 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 202/406] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:14 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:14.964858 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-23734a3d-c90a-496f-9567-eec6c9c96b1c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:14.965545 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-23734a3d-c90a-496f-9567-eec6c9c96b1c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:14.971740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-23734a3d-c90a-496f-9567-eec6c9c96b1c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:14.972510 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-23734a3d-c90a-496f-9567-eec6c9c96b1c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:14.973330 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-23734a3d-c90a-496f-9567-eec6c9c96b1c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:14.973928 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-23734a3d-c90a-496f-9567-eec6c9c96b1c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:15.125975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-23734a3d-c90a-496f-9567-eec6c9c96b1c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:15.134661 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-23734a3d-c90a-496f-9567-eec6c9c96b1c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1712 microversion: 2.1 time: 0.173545 Jul 25 06:01:15.135229 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 203/407] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:14 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1712 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:15.139642 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8edacd73-de1f-4dd8-ac21-db1c37b879f4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:15.140254 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8edacd73-de1f-4dd8-ac21-db1c37b879f4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:15.146407 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8edacd73-de1f-4dd8-ac21-db1c37b879f4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:15.147001 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8edacd73-de1f-4dd8-ac21-db1c37b879f4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:15.147773 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8edacd73-de1f-4dd8-ac21-db1c37b879f4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:15.148200 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8edacd73-de1f-4dd8-ac21-db1c37b879f4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:15.329298 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8edacd73-de1f-4dd8-ac21-db1c37b879f4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:15.337745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8edacd73-de1f-4dd8-ac21-db1c37b879f4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:15.339543 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8edacd73-de1f-4dd8-ac21-db1c37b879f4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:15.340771 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-8edacd73-de1f-4dd8-ac21-db1c37b879f4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1737 microversion: 2.20 time: 0.204635 Jul 25 06:01:15.341402 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 204/408] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:15 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:15.681109 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.network.neutron [None req-294a38af-4962-4af7-8b9f-2728368d76bb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] validate_networks() for [('b267e454-5603-4afc-b3f7-189ef5d55d73', None, None, None, None, None)] {{(pid=130163) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:01:15.980990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d28c4b59-0623-445f-977f-6e8e539ee822 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:15.980990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d28c4b59-0623-445f-977f-6e8e539ee822 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:15.984720 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d28c4b59-0623-445f-977f-6e8e539ee822 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:15.985294 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d28c4b59-0623-445f-977f-6e8e539ee822 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:15.986141 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d28c4b59-0623-445f-977f-6e8e539ee822 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:15.986802 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d28c4b59-0623-445f-977f-6e8e539ee822 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:15.995334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:16.186705 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d28c4b59-0623-445f-977f-6e8e539ee822 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:16.196015 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d28c4b59-0623-445f-977f-6e8e539ee822 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1314 microversion: 2.1 time: 0.223361 Jul 25 06:01:16.196907 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 205/409] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:15 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:16.208855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-52738a7e-70de-4bf0-9c0e-584f0e3d8f63 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:16.209477 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-52738a7e-70de-4bf0-9c0e-584f0e3d8f63 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:16.216903 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-52738a7e-70de-4bf0-9c0e-584f0e3d8f63 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:16.217355 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-52738a7e-70de-4bf0-9c0e-584f0e3d8f63 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:16.218122 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-52738a7e-70de-4bf0-9c0e-584f0e3d8f63 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:16.218588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-52738a7e-70de-4bf0-9c0e-584f0e3d8f63 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:16.297755 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-294a38af-4962-4af7-8b9f-2728368d76bb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Flavor limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:01:16.298211 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-294a38af-4962-4af7-8b9f-2728368d76bb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Image limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:01:16.299047 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-294a38af-4962-4af7-8b9f-2728368d76bb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Flavor pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:01:16.299615 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-294a38af-4962-4af7-8b9f-2728368d76bb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Image pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:01:16.300101 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-294a38af-4962-4af7-8b9f-2728368d76bb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:01:16.314413 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-294a38af-4962-4af7-8b9f-2728368d76bb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:16.315415 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-294a38af-4962-4af7-8b9f-2728368d76bb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:16.316420 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-294a38af-4962-4af7-8b9f-2728368d76bb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:16.317103 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-294a38af-4962-4af7-8b9f-2728368d76bb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:16.347744 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-294a38af-4962-4af7-8b9f-2728368d76bb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Getting quotas for project d30518907b9f4939b1e8666eba12186e. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:01:16.356140 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-294a38af-4962-4af7-8b9f-2728368d76bb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Getting quotas for user 13e5d648af294c7cbc86ccd362914728 and project d30518907b9f4939b1e8666eba12186e. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:01:16.371359 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-294a38af-4962-4af7-8b9f-2728368d76bb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Going to run 1 instances... {{(pid=130163) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:01:16.374167 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-294a38af-4962-4af7-8b9f-2728368d76bb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfffd6ef-7f99-4a99-90f3-027fe9c89821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:01:16.378882 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-52738a7e-70de-4bf0-9c0e-584f0e3d8f63 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:16.388997 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-52738a7e-70de-4bf0-9c0e-584f0e3d8f63 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1712 microversion: 2.1 time: 0.191078 Jul 25 06:01:16.389579 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 206/410] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:16 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1712 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:16.393997 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-bc646cca-b27b-43b9-9541-45ac996f3670 req-c8cfcc02-bff6-46f7-8a08-c352665db2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb485129-6941-49db-9cee-c83f53f2bdff", "tag": "08aafc3d-895b-4cc7-84fd-174d4858268a"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:16.402360 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-bc646cca-b27b-43b9-9541-45ac996f3670 req-c8cfcc02-bff6-46f7-8a08-c352665db2f6 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:16.402992 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-bc646cca-b27b-43b9-9541-45ac996f3670 req-c8cfcc02-bff6-46f7-8a08-c352665db2f6 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:16.420414 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-bc646cca-b27b-43b9-9541-45ac996f3670 req-c8cfcc02-bff6-46f7-8a08-c352665db2f6 service nova] Creating event network-changed:08aafc3d-895b-4cc7-84fd-174d4858268a for instance fb485129-6941-49db-9cee-c83f53f2bdff on hv-cinder-85083 Jul 25 06:01:16.425040 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-bc646cca-b27b-43b9-9541-45ac996f3670 req-c8cfcc02-bff6-46f7-8a08-c352665db2f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034344 Jul 25 06:01:16.425767 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 207/411] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:16.431590 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-c6ae5bdc-82bd-43e4-ae2e-2d1c0cc7fb50 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:16.432280 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-c6ae5bdc-82bd-43e4-ae2e-2d1c0cc7fb50 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:16.440068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c6ae5bdc-82bd-43e4-ae2e-2d1c0cc7fb50 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:16.440509 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c6ae5bdc-82bd-43e4-ae2e-2d1c0cc7fb50 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:16.441267 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c6ae5bdc-82bd-43e4-ae2e-2d1c0cc7fb50 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:16.441692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c6ae5bdc-82bd-43e4-ae2e-2d1c0cc7fb50 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:16.454315 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:16.550654 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-294a38af-4962-4af7-8b9f-2728368d76bb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 7.833372 Jul 25 06:01:16.551802 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 205/412] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 06:01:08 2022] POST /compute/v2.1/servers => generated 409 bytes in 7840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:01:16.565353 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5c091210-d24a-4e35-84d6-a142dfb420a7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:16.567632 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5c091210-d24a-4e35-84d6-a142dfb420a7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:16.617465 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-c6ae5bdc-82bd-43e4-ae2e-2d1c0cc7fb50 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:16.629778 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-c6ae5bdc-82bd-43e4-ae2e-2d1c0cc7fb50 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:16.636070 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-c6ae5bdc-82bd-43e4-ae2e-2d1c0cc7fb50 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:16.637386 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-c6ae5bdc-82bd-43e4-ae2e-2d1c0cc7fb50 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1737 microversion: 2.20 time: 0.210560 Jul 25 06:01:16.660194 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 208/413] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:16 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1737 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:16.678030 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5c091210-d24a-4e35-84d6-a142dfb420a7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:16.687080 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5c091210-d24a-4e35-84d6-a142dfb420a7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1246 microversion: 2.1 time: 0.128818 Jul 25 06:01:16.688829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 206/414] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:16 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1246 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:17.212911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a05886cb-f960-4a1f-88e7-f8d312df0284 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:17.213486 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a05886cb-f960-4a1f-88e7-f8d312df0284 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:17.220396 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a05886cb-f960-4a1f-88e7-f8d312df0284 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:17.220853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a05886cb-f960-4a1f-88e7-f8d312df0284 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:17.221692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a05886cb-f960-4a1f-88e7-f8d312df0284 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:17.222123 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a05886cb-f960-4a1f-88e7-f8d312df0284 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:17.357726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-a05886cb-f960-4a1f-88e7-f8d312df0284 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:17.366747 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a05886cb-f960-4a1f-88e7-f8d312df0284 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1314 microversion: 2.1 time: 0.158693 Jul 25 06:01:17.367484 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 209/415] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:17 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:17.405742 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-24477d66-083e-4954-8ad9-7e276e86add4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:17.406402 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-24477d66-083e-4954-8ad9-7e276e86add4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:17.413337 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-24477d66-083e-4954-8ad9-7e276e86add4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:17.413779 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-24477d66-083e-4954-8ad9-7e276e86add4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:17.414598 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-24477d66-083e-4954-8ad9-7e276e86add4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:17.415026 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-24477d66-083e-4954-8ad9-7e276e86add4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:17.541855 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-24477d66-083e-4954-8ad9-7e276e86add4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:17.549998 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-24477d66-083e-4954-8ad9-7e276e86add4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1712 microversion: 2.1 time: 0.148649 Jul 25 06:01:17.550582 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 207/416] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:17 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1712 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:17.659824 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-06bfea14-1ca6-4172-9b70-801f87c15ec8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:17.660363 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-06bfea14-1ca6-4172-9b70-801f87c15ec8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:17.667272 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-06bfea14-1ca6-4172-9b70-801f87c15ec8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:17.667726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-06bfea14-1ca6-4172-9b70-801f87c15ec8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:17.668481 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-06bfea14-1ca6-4172-9b70-801f87c15ec8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:17.668942 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-06bfea14-1ca6-4172-9b70-801f87c15ec8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:17.707546 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-63e71df0-c2b7-4200-909c-3cb1d577374f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:17.708229 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-63e71df0-c2b7-4200-909c-3cb1d577374f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:17.714063 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63e71df0-c2b7-4200-909c-3cb1d577374f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:17.714537 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63e71df0-c2b7-4200-909c-3cb1d577374f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:17.715312 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63e71df0-c2b7-4200-909c-3cb1d577374f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:17.715750 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63e71df0-c2b7-4200-909c-3cb1d577374f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:17.734234 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=100 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:17.782237 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-63e71df0-c2b7-4200-909c-3cb1d577374f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:17.788467 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-63e71df0-c2b7-4200-909c-3cb1d577374f tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1250 microversion: 2.1 time: 0.084469 Jul 25 06:01:17.789055 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 208/417] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:17 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:17.801212 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-06bfea14-1ca6-4172-9b70-801f87c15ec8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:17.809648 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-06bfea14-1ca6-4172-9b70-801f87c15ec8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:17.811191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-06bfea14-1ca6-4172-9b70-801f87c15ec8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:17.812343 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-06bfea14-1ca6-4172-9b70-801f87c15ec8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1737 microversion: 2.20 time: 0.156523 Jul 25 06:01:17.812896 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 210/418] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:17 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:18.384095 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6f1956a1-c1c5-4d00-a43a-6d95a82d5066 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:18.384734 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6f1956a1-c1c5-4d00-a43a-6d95a82d5066 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:18.390720 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6f1956a1-c1c5-4d00-a43a-6d95a82d5066 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:18.391191 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6f1956a1-c1c5-4d00-a43a-6d95a82d5066 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:18.391949 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6f1956a1-c1c5-4d00-a43a-6d95a82d5066 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:18.392383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6f1956a1-c1c5-4d00-a43a-6d95a82d5066 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:18.519180 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6f1956a1-c1c5-4d00-a43a-6d95a82d5066 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:18.527481 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6f1956a1-c1c5-4d00-a43a-6d95a82d5066 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1314 microversion: 2.1 time: 0.147534 Jul 25 06:01:18.528092 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 209/419] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:18 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:18.568001 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2d2f85a4-4557-4da0-860e-8ffe30206cf3 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:18.568605 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2d2f85a4-4557-4da0-860e-8ffe30206cf3 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:18.575203 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2d2f85a4-4557-4da0-860e-8ffe30206cf3 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:18.575642 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2d2f85a4-4557-4da0-860e-8ffe30206cf3 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:18.576393 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2d2f85a4-4557-4da0-860e-8ffe30206cf3 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:18.576838 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2d2f85a4-4557-4da0-860e-8ffe30206cf3 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:18.706576 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2d2f85a4-4557-4da0-860e-8ffe30206cf3 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:18.715319 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2d2f85a4-4557-4da0-860e-8ffe30206cf3 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1712 microversion: 2.1 time: 0.151662 Jul 25 06:01:18.715887 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 211/420] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:18 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1712 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:18.805931 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-388ee207-129b-46f9-ba96-7427398a29a8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:18.806464 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-388ee207-129b-46f9-ba96-7427398a29a8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:18.812573 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-388ee207-129b-46f9-ba96-7427398a29a8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:18.813049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-388ee207-129b-46f9-ba96-7427398a29a8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:18.813805 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-388ee207-129b-46f9-ba96-7427398a29a8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:18.814240 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-388ee207-129b-46f9-ba96-7427398a29a8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:18.830806 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b0a58206-d132-46a4-9766-a2ee380280b3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:18.831558 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b0a58206-d132-46a4-9766-a2ee380280b3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:18.837394 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b0a58206-d132-46a4-9766-a2ee380280b3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:18.837839 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b0a58206-d132-46a4-9766-a2ee380280b3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:18.838735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b0a58206-d132-46a4-9766-a2ee380280b3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:18.839173 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b0a58206-d132-46a4-9766-a2ee380280b3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:18.874734 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-388ee207-129b-46f9-ba96-7427398a29a8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:18.882930 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-388ee207-129b-46f9-ba96-7427398a29a8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1250 microversion: 2.1 time: 0.081401 Jul 25 06:01:18.883502 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 210/421] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:18 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:18.969244 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b0a58206-d132-46a4-9766-a2ee380280b3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:18.977609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b0a58206-d132-46a4-9766-a2ee380280b3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:18.979138 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b0a58206-d132-46a4-9766-a2ee380280b3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:18.980305 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b0a58206-d132-46a4-9766-a2ee380280b3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1737 microversion: 2.20 time: 0.153532 Jul 25 06:01:18.980859 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 212/422] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:18 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:01:19.544293 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6be523fb-4f58-4a68-8336-634c92e6313c tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:19.544914 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6be523fb-4f58-4a68-8336-634c92e6313c tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:19.551356 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6be523fb-4f58-4a68-8336-634c92e6313c tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:19.551767 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6be523fb-4f58-4a68-8336-634c92e6313c tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:19.553062 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6be523fb-4f58-4a68-8336-634c92e6313c tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:19.553499 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6be523fb-4f58-4a68-8336-634c92e6313c tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:19.683402 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6be523fb-4f58-4a68-8336-634c92e6313c tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:19.690947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6be523fb-4f58-4a68-8336-634c92e6313c tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1314 microversion: 2.1 time: 0.150536 Jul 25 06:01:19.691501 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 211/423] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:19 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:19.732020 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6a8592b6-34a4-4eca-81ba-3043f4bb41a7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:19.732629 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-6a8592b6-34a4-4eca-81ba-3043f4bb41a7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:19.739234 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6a8592b6-34a4-4eca-81ba-3043f4bb41a7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:19.740204 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6a8592b6-34a4-4eca-81ba-3043f4bb41a7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:19.740951 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6a8592b6-34a4-4eca-81ba-3043f4bb41a7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:19.741378 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6a8592b6-34a4-4eca-81ba-3043f4bb41a7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:19.879676 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-6a8592b6-34a4-4eca-81ba-3043f4bb41a7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:19.887694 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-6a8592b6-34a4-4eca-81ba-3043f4bb41a7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1716 microversion: 2.1 time: 0.159839 Jul 25 06:01:19.888206 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 213/424] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:19 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:19.901542 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-59aaa0f6-0626-4fc8-a66c-112fe0f89dba tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:19.902165 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-59aaa0f6-0626-4fc8-a66c-112fe0f89dba tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:19.909021 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-59aaa0f6-0626-4fc8-a66c-112fe0f89dba tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:19.909618 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-59aaa0f6-0626-4fc8-a66c-112fe0f89dba tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:19.910888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-59aaa0f6-0626-4fc8-a66c-112fe0f89dba tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:19.911874 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-59aaa0f6-0626-4fc8-a66c-112fe0f89dba tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:19.975923 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-59aaa0f6-0626-4fc8-a66c-112fe0f89dba tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:19.983399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-59aaa0f6-0626-4fc8-a66c-112fe0f89dba tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1250 microversion: 2.1 time: 0.085950 Jul 25 06:01:19.983952 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 212/425] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:19 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1250 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:19.998072 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-44fbbb6b-1c3f-414a-88fd-0972c8ad71a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:19.998724 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-44fbbb6b-1c3f-414a-88fd-0972c8ad71a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:20.004616 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-44fbbb6b-1c3f-414a-88fd-0972c8ad71a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:20.005061 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-44fbbb6b-1c3f-414a-88fd-0972c8ad71a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:20.005814 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-44fbbb6b-1c3f-414a-88fd-0972c8ad71a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:20.006244 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-44fbbb6b-1c3f-414a-88fd-0972c8ad71a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:20.199571 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-44fbbb6b-1c3f-414a-88fd-0972c8ad71a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:20.209476 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-44fbbb6b-1c3f-414a-88fd-0972c8ad71a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:20.212696 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-44fbbb6b-1c3f-414a-88fd-0972c8ad71a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:20.212696 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-44fbbb6b-1c3f-414a-88fd-0972c8ad71a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1737 microversion: 2.20 time: 0.218125 Jul 25 06:01:20.212900 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 214/426] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:19 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:20.709156 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7d8f835d-db0e-4bc5-981f-588d411a32b0 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:20.709686 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7d8f835d-db0e-4bc5-981f-588d411a32b0 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:20.716123 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7d8f835d-db0e-4bc5-981f-588d411a32b0 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:20.716609 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7d8f835d-db0e-4bc5-981f-588d411a32b0 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:20.717365 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7d8f835d-db0e-4bc5-981f-588d411a32b0 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:20.717792 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7d8f835d-db0e-4bc5-981f-588d411a32b0 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:20.889409 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7d8f835d-db0e-4bc5-981f-588d411a32b0 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:20.901887 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-7d8f835d-db0e-4bc5-981f-588d411a32b0 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1497 microversion: 2.1 time: 0.197598 Jul 25 06:01:20.908476 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 213/427] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:20 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:21.000351 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a8a4a069-6c65-420d-8975-0b4b7738f1e2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:21.000988 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a8a4a069-6c65-420d-8975-0b4b7738f1e2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:21.008234 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a8a4a069-6c65-420d-8975-0b4b7738f1e2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:21.008683 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a8a4a069-6c65-420d-8975-0b4b7738f1e2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:21.009452 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a8a4a069-6c65-420d-8975-0b4b7738f1e2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:21.009963 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a8a4a069-6c65-420d-8975-0b4b7738f1e2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:21.077823 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-a8a4a069-6c65-420d-8975-0b4b7738f1e2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:21.080940 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a8a4a069-6c65-420d-8975-0b4b7738f1e2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1242 microversion: 2.1 time: 0.084362 Jul 25 06:01:21.081551 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 215/428] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:20 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:21.231318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5fc01930-7980-4851-915a-1b27c68c03c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:21.232624 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5fc01930-7980-4851-915a-1b27c68c03c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:21.238851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5fc01930-7980-4851-915a-1b27c68c03c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:21.239300 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5fc01930-7980-4851-915a-1b27c68c03c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:21.240603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5fc01930-7980-4851-915a-1b27c68c03c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:21.241066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5fc01930-7980-4851-915a-1b27c68c03c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:21.410144 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5fc01930-7980-4851-915a-1b27c68c03c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:21.419889 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5fc01930-7980-4851-915a-1b27c68c03c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:21.421434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5fc01930-7980-4851-915a-1b27c68c03c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:21.422621 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5fc01930-7980-4851-915a-1b27c68c03c2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1719 microversion: 2.20 time: 0.196124 Jul 25 06:01:21.423179 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 214/429] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:21 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1719 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:22.098054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b1cfdf89-3922-46d5-8471-8b2ef0ae6679 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:22.098678 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b1cfdf89-3922-46d5-8471-8b2ef0ae6679 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:22.101051 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=100 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:22.105788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b1cfdf89-3922-46d5-8471-8b2ef0ae6679 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:22.106233 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b1cfdf89-3922-46d5-8471-8b2ef0ae6679 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:22.107016 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b1cfdf89-3922-46d5-8471-8b2ef0ae6679 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:22.107443 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b1cfdf89-3922-46d5-8471-8b2ef0ae6679 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:22.174485 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b1cfdf89-3922-46d5-8471-8b2ef0ae6679 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:22.181956 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b1cfdf89-3922-46d5-8471-8b2ef0ae6679 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1298 microversion: 2.1 time: 0.088513 Jul 25 06:01:22.182559 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 216/430] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:22 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:22.441431 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-848117db-dd9d-4dc8-8e9a-4d7246cd9af1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:22.442047 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-848117db-dd9d-4dc8-8e9a-4d7246cd9af1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:22.451236 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-848117db-dd9d-4dc8-8e9a-4d7246cd9af1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:22.451692 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-848117db-dd9d-4dc8-8e9a-4d7246cd9af1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:22.452649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-848117db-dd9d-4dc8-8e9a-4d7246cd9af1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:22.453424 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-848117db-dd9d-4dc8-8e9a-4d7246cd9af1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:22.581684 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-848117db-dd9d-4dc8-8e9a-4d7246cd9af1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:22.589773 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-848117db-dd9d-4dc8-8e9a-4d7246cd9af1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:22.591365 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-848117db-dd9d-4dc8-8e9a-4d7246cd9af1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:22.592646 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-848117db-dd9d-4dc8-8e9a-4d7246cd9af1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1719 microversion: 2.20 time: 0.155148 Jul 25 06:01:22.593191 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 215/431] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:22 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:23.198842 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-eeb45388-9795-4865-96a3-7009de9abd8b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:23.199460 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-eeb45388-9795-4865-96a3-7009de9abd8b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:23.206193 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eeb45388-9795-4865-96a3-7009de9abd8b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:23.206678 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eeb45388-9795-4865-96a3-7009de9abd8b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:23.207529 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eeb45388-9795-4865-96a3-7009de9abd8b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:23.207877 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eeb45388-9795-4865-96a3-7009de9abd8b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:23.288181 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-eeb45388-9795-4865-96a3-7009de9abd8b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:23.295981 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-eeb45388-9795-4865-96a3-7009de9abd8b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1298 microversion: 2.1 time: 0.101086 Jul 25 06:01:23.296553 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 217/432] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:23 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:23.610877 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2b21b124-d2d2-4597-b7a2-fc97b8d8d3cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:23.611499 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2b21b124-d2d2-4597-b7a2-fc97b8d8d3cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:23.618702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2b21b124-d2d2-4597-b7a2-fc97b8d8d3cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:23.619150 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2b21b124-d2d2-4597-b7a2-fc97b8d8d3cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:23.619928 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2b21b124-d2d2-4597-b7a2-fc97b8d8d3cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:23.620463 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2b21b124-d2d2-4597-b7a2-fc97b8d8d3cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:23.758724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2b21b124-d2d2-4597-b7a2-fc97b8d8d3cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:23.764041 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2b21b124-d2d2-4597-b7a2-fc97b8d8d3cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:23.765638 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2b21b124-d2d2-4597-b7a2-fc97b8d8d3cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:23.767174 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2b21b124-d2d2-4597-b7a2-fc97b8d8d3cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1719 microversion: 2.20 time: 0.160367 Jul 25 06:01:23.767855 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 216/433] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:23 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:24.312787 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1f435ca5-4e0c-4bb9-8b22-79ea020ed91d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:24.313670 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1f435ca5-4e0c-4bb9-8b22-79ea020ed91d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:24.320856 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1f435ca5-4e0c-4bb9-8b22-79ea020ed91d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:24.321379 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1f435ca5-4e0c-4bb9-8b22-79ea020ed91d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:24.322207 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1f435ca5-4e0c-4bb9-8b22-79ea020ed91d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:24.322758 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1f435ca5-4e0c-4bb9-8b22-79ea020ed91d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:24.414450 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1f435ca5-4e0c-4bb9-8b22-79ea020ed91d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:24.422034 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1f435ca5-4e0c-4bb9-8b22-79ea020ed91d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1298 microversion: 2.1 time: 0.113090 Jul 25 06:01:24.432858 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 218/434] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:24 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:24.785462 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9471c699-2655-43db-95ca-d4db01343c25 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:24.786218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-9471c699-2655-43db-95ca-d4db01343c25 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:24.793724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9471c699-2655-43db-95ca-d4db01343c25 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:24.794266 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9471c699-2655-43db-95ca-d4db01343c25 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:24.795131 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9471c699-2655-43db-95ca-d4db01343c25 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:24.795636 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9471c699-2655-43db-95ca-d4db01343c25 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:24.938102 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9471c699-2655-43db-95ca-d4db01343c25 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:24.949001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9471c699-2655-43db-95ca-d4db01343c25 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:24.950908 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9471c699-2655-43db-95ca-d4db01343c25 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:24.952358 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9471c699-2655-43db-95ca-d4db01343c25 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1719 microversion: 2.20 time: 0.170807 Jul 25 06:01:24.953099 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 217/435] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:24 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:25.082528 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-afb0b9fa-ddb0-4c64-81ab-ffc7204af0bb tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:25.083177 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-afb0b9fa-ddb0-4c64-81ab-ffc7204af0bb tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:25.090728 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-afb0b9fa-ddb0-4c64-81ab-ffc7204af0bb tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:25.091177 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-afb0b9fa-ddb0-4c64-81ab-ffc7204af0bb tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:25.092116 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-afb0b9fa-ddb0-4c64-81ab-ffc7204af0bb tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:25.092745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-afb0b9fa-ddb0-4c64-81ab-ffc7204af0bb tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:25.121239 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-afb0b9fa-ddb0-4c64-81ab-ffc7204af0bb tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Going to try to terminate instance {{(pid=130162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:01:25.369899 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-8bc142e0-4cb6-465d-be49-02b9db609437 req-821e5710-9e1f-4776-a152-90d8fc5359cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "348f256d-41e5-47d8-b165-cad6dfcd0be9", "name": "network-vif-unplugged", "status": "completed", "tag": "f9f7f9cc-3fd7-49f4-b8f2-59f247cf93e3"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:25.376686 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-afb0b9fa-ddb0-4c64-81ab-ffc7204af0bb tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "DELETE /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 204 len: 0 microversion: 2.1 time: 0.297867 Jul 25 06:01:25.377275 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 219/436] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:01:25 2022] DELETE /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:01:25.387396 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-8bc142e0-4cb6-465d-be49-02b9db609437 req-821e5710-9e1f-4776-a152-90d8fc5359cf service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:25.387851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-8bc142e0-4cb6-465d-be49-02b9db609437 req-821e5710-9e1f-4776-a152-90d8fc5359cf service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:25.387979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b77f6853-1363-456d-b54e-cf912ea39383 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:25.388981 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b77f6853-1363-456d-b54e-cf912ea39383 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:25.395348 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b77f6853-1363-456d-b54e-cf912ea39383 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:25.396581 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b77f6853-1363-456d-b54e-cf912ea39383 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:25.399001 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b77f6853-1363-456d-b54e-cf912ea39383 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:25.399652 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b77f6853-1363-456d-b54e-cf912ea39383 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:25.399853 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-8bc142e0-4cb6-465d-be49-02b9db609437 req-821e5710-9e1f-4776-a152-90d8fc5359cf service nova] Creating event network-vif-unplugged:f9f7f9cc-3fd7-49f4-b8f2-59f247cf93e3 for instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 on hv-cinder-85083 Jul 25 06:01:25.405105 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-8bc142e0-4cb6-465d-be49-02b9db609437 req-821e5710-9e1f-4776-a152-90d8fc5359cf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040089 Jul 25 06:01:25.407085 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 218/437] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:25.440681 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7983ffc2-905f-41a8-95e4-513661b3be9d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:25.441383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7983ffc2-905f-41a8-95e4-513661b3be9d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:25.454274 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7983ffc2-905f-41a8-95e4-513661b3be9d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:25.454819 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7983ffc2-905f-41a8-95e4-513661b3be9d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:25.456035 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7983ffc2-905f-41a8-95e4-513661b3be9d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:25.459080 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7983ffc2-905f-41a8-95e4-513661b3be9d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:25.553999 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7983ffc2-905f-41a8-95e4-513661b3be9d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:25.562234 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-7983ffc2-905f-41a8-95e4-513661b3be9d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1304 microversion: 2.1 time: 0.125610 Jul 25 06:01:25.562841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 219/438] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:25 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:25.660704 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b77f6853-1363-456d-b54e-cf912ea39383 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:25.668152 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:25.670739 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b77f6853-1363-456d-b54e-cf912ea39383 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1503 microversion: 2.1 time: 0.288011 Jul 25 06:01:25.671782 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 220/439] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:25 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1503 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:25.971550 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-746da528-99c1-4072-930f-99da595eb9d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:25.972255 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-746da528-99c1-4072-930f-99da595eb9d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:25.979544 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-746da528-99c1-4072-930f-99da595eb9d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:25.979983 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-746da528-99c1-4072-930f-99da595eb9d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:25.980769 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-746da528-99c1-4072-930f-99da595eb9d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:25.981194 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-746da528-99c1-4072-930f-99da595eb9d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:26.131832 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-746da528-99c1-4072-930f-99da595eb9d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:26.140508 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-746da528-99c1-4072-930f-99da595eb9d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:26.146543 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-746da528-99c1-4072-930f-99da595eb9d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:26.146543 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-746da528-99c1-4072-930f-99da595eb9d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1719 microversion: 2.20 time: 0.175633 Jul 25 06:01:26.146543 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 220/440] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:25 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:26.580898 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0f7d5ef4-b94a-4f8a-a8fe-be8b24935dec tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:26.581622 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0f7d5ef4-b94a-4f8a-a8fe-be8b24935dec tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:26.589285 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0f7d5ef4-b94a-4f8a-a8fe-be8b24935dec tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:26.589723 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0f7d5ef4-b94a-4f8a-a8fe-be8b24935dec tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:26.591160 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0f7d5ef4-b94a-4f8a-a8fe-be8b24935dec tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:26.591160 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0f7d5ef4-b94a-4f8a-a8fe-be8b24935dec tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:26.696063 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-68b9273f-1d11-4829-ae63-c4aff8efce1d tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:26.696778 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-68b9273f-1d11-4829-ae63-c4aff8efce1d tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:26.698829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=2 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:26.699577 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=8 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:26.704296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-68b9273f-1d11-4829-ae63-c4aff8efce1d tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:26.704748 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-68b9273f-1d11-4829-ae63-c4aff8efce1d tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:26.705567 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-68b9273f-1d11-4829-ae63-c4aff8efce1d tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:26.706202 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-68b9273f-1d11-4829-ae63-c4aff8efce1d tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:26.732064 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0f7d5ef4-b94a-4f8a-a8fe-be8b24935dec tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:26.739989 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0f7d5ef4-b94a-4f8a-a8fe-be8b24935dec tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1372 microversion: 2.1 time: 0.163466 Jul 25 06:01:26.749596 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 221/441] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:26 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:26.854016 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-68b9273f-1d11-4829-ae63-c4aff8efce1d tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:26.861541 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-68b9273f-1d11-4829-ae63-c4aff8efce1d tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1503 microversion: 2.1 time: 0.170110 Jul 25 06:01:26.862114 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 221/442] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:26 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:27.161728 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f72aa0e0-42c1-4889-a853-c554e4073f61 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:27.162271 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f72aa0e0-42c1-4889-a853-c554e4073f61 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:27.169123 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f72aa0e0-42c1-4889-a853-c554e4073f61 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:27.169566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f72aa0e0-42c1-4889-a853-c554e4073f61 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:27.170313 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f72aa0e0-42c1-4889-a853-c554e4073f61 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:27.170768 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f72aa0e0-42c1-4889-a853-c554e4073f61 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:27.301167 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-f72aa0e0-42c1-4889-a853-c554e4073f61 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:27.309720 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-f72aa0e0-42c1-4889-a853-c554e4073f61 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:27.311291 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-f72aa0e0-42c1-4889-a853-c554e4073f61 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:27.312442 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f72aa0e0-42c1-4889-a853-c554e4073f61 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1719 microversion: 2.20 time: 0.154727 Jul 25 06:01:27.312994 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 222/443] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:27 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:27.756454 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6ff4dccc-620c-488f-81e3-4cbaf1d56aac tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:27.756994 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6ff4dccc-620c-488f-81e3-4cbaf1d56aac tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:27.763489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6ff4dccc-620c-488f-81e3-4cbaf1d56aac tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:27.763937 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6ff4dccc-620c-488f-81e3-4cbaf1d56aac tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:27.764696 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6ff4dccc-620c-488f-81e3-4cbaf1d56aac tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:27.765133 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6ff4dccc-620c-488f-81e3-4cbaf1d56aac tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:27.878969 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b2813051-1dc0-4a74-bf0e-da7022f2c3c1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:27.879696 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b2813051-1dc0-4a74-bf0e-da7022f2c3c1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:27.886124 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b2813051-1dc0-4a74-bf0e-da7022f2c3c1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:27.886603 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b2813051-1dc0-4a74-bf0e-da7022f2c3c1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:27.887369 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b2813051-1dc0-4a74-bf0e-da7022f2c3c1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:27.887805 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b2813051-1dc0-4a74-bf0e-da7022f2c3c1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:27.889877 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6ff4dccc-620c-488f-81e3-4cbaf1d56aac tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:27.897269 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6ff4dccc-620c-488f-81e3-4cbaf1d56aac tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1372 microversion: 2.1 time: 0.144836 Jul 25 06:01:27.898543 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 222/444] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:27 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1372 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:28.020351 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b2813051-1dc0-4a74-bf0e-da7022f2c3c1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:28.027825 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b2813051-1dc0-4a74-bf0e-da7022f2c3c1 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1503 microversion: 2.1 time: 0.152714 Jul 25 06:01:28.028381 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 223/445] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:27 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:28.330632 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-00d0b1ff-a45e-4ac2-b3be-370f35345065 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:28.331228 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-00d0b1ff-a45e-4ac2-b3be-370f35345065 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:28.337926 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-00d0b1ff-a45e-4ac2-b3be-370f35345065 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:28.338378 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-00d0b1ff-a45e-4ac2-b3be-370f35345065 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:28.339171 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-00d0b1ff-a45e-4ac2-b3be-370f35345065 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:28.339610 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-00d0b1ff-a45e-4ac2-b3be-370f35345065 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:28.466666 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-00d0b1ff-a45e-4ac2-b3be-370f35345065 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:28.474387 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-00d0b1ff-a45e-4ac2-b3be-370f35345065 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:28.475927 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-00d0b1ff-a45e-4ac2-b3be-370f35345065 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:28.477068 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-00d0b1ff-a45e-4ac2-b3be-370f35345065 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1719 microversion: 2.20 time: 0.150474 Jul 25 06:01:28.477627 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 223/446] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:28 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:28.915320 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0405c7c8-4e4b-4072-903b-e501103e22c8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:28.915928 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0405c7c8-4e4b-4072-903b-e501103e22c8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:28.922690 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0405c7c8-4e4b-4072-903b-e501103e22c8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:28.923132 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0405c7c8-4e4b-4072-903b-e501103e22c8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:28.923877 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0405c7c8-4e4b-4072-903b-e501103e22c8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:28.924302 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0405c7c8-4e4b-4072-903b-e501103e22c8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:29.045484 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9c4d3bc8-5d66-4c83-8e52-35a21ee19e4b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:29.046095 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-9c4d3bc8-5d66-4c83-8e52-35a21ee19e4b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:29.052299 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0405c7c8-4e4b-4072-903b-e501103e22c8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:29.053088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9c4d3bc8-5d66-4c83-8e52-35a21ee19e4b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:29.053606 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9c4d3bc8-5d66-4c83-8e52-35a21ee19e4b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:29.055017 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9c4d3bc8-5d66-4c83-8e52-35a21ee19e4b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:29.055454 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9c4d3bc8-5d66-4c83-8e52-35a21ee19e4b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:29.060541 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0405c7c8-4e4b-4072-903b-e501103e22c8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1372 microversion: 2.1 time: 0.150068 Jul 25 06:01:29.061107 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 224/447] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:28 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:29.182219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9c4d3bc8-5d66-4c83-8e52-35a21ee19e4b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:29.189548 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9c4d3bc8-5d66-4c83-8e52-35a21ee19e4b tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1503 microversion: 2.1 time: 0.148138 Jul 25 06:01:29.190111 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 224/448] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:29 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:29.495189 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d855a4a2-ae98-435c-b794-c1c695597b3b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:29.495831 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d855a4a2-ae98-435c-b794-c1c695597b3b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:29.501977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d855a4a2-ae98-435c-b794-c1c695597b3b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:29.502428 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d855a4a2-ae98-435c-b794-c1c695597b3b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:29.503270 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d855a4a2-ae98-435c-b794-c1c695597b3b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:29.503657 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d855a4a2-ae98-435c-b794-c1c695597b3b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:29.637749 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d855a4a2-ae98-435c-b794-c1c695597b3b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:29.645771 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d855a4a2-ae98-435c-b794-c1c695597b3b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:29.647302 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d855a4a2-ae98-435c-b794-c1c695597b3b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:29.649057 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d855a4a2-ae98-435c-b794-c1c695597b3b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1719 microversion: 2.20 time: 0.157813 Jul 25 06:01:29.649614 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 225/449] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:29 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:30.077148 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e5040607-285b-4a4f-970f-63c71af6a8c6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:30.077752 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e5040607-285b-4a4f-970f-63c71af6a8c6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:30.084282 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e5040607-285b-4a4f-970f-63c71af6a8c6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:30.084722 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e5040607-285b-4a4f-970f-63c71af6a8c6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:30.085478 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e5040607-285b-4a4f-970f-63c71af6a8c6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:30.085910 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e5040607-285b-4a4f-970f-63c71af6a8c6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:30.206632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6ce5f3a1-010e-4561-a74e-6cc9745eb9e9 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:30.207421 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-6ce5f3a1-010e-4561-a74e-6cc9745eb9e9 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:30.214786 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6ce5f3a1-010e-4561-a74e-6cc9745eb9e9 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:30.215468 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6ce5f3a1-010e-4561-a74e-6cc9745eb9e9 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:30.216308 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6ce5f3a1-010e-4561-a74e-6cc9745eb9e9 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:30.216807 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6ce5f3a1-010e-4561-a74e-6cc9745eb9e9 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:30.220788 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e5040607-285b-4a4f-970f-63c71af6a8c6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:30.224545 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=100 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:30.229767 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e5040607-285b-4a4f-970f-63c71af6a8c6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1372 microversion: 2.1 time: 0.156439 Jul 25 06:01:30.230350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 225/450] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:30 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:30.386404 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-6ce5f3a1-010e-4561-a74e-6cc9745eb9e9 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:30.395830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-6ce5f3a1-010e-4561-a74e-6cc9745eb9e9 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1503 microversion: 2.1 time: 0.193019 Jul 25 06:01:30.396494 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 226/451] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:30 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:30.669969 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2a6fcbfb-2e8c-4d94-8814-d8ec2c4c8358 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:30.670809 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2a6fcbfb-2e8c-4d94-8814-d8ec2c4c8358 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:30.680898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2a6fcbfb-2e8c-4d94-8814-d8ec2c4c8358 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:30.681748 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2a6fcbfb-2e8c-4d94-8814-d8ec2c4c8358 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:30.683669 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2a6fcbfb-2e8c-4d94-8814-d8ec2c4c8358 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:30.684886 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2a6fcbfb-2e8c-4d94-8814-d8ec2c4c8358 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:30.831309 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2a6fcbfb-2e8c-4d94-8814-d8ec2c4c8358 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:30.839538 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2a6fcbfb-2e8c-4d94-8814-d8ec2c4c8358 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:30.841065 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2a6fcbfb-2e8c-4d94-8814-d8ec2c4c8358 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:30.842316 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2a6fcbfb-2e8c-4d94-8814-d8ec2c4c8358 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1719 microversion: 2.20 time: 0.178569 Jul 25 06:01:30.852728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 226/452] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:30 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1719 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:30.975682 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-5b6ba3ea-fb5b-4dbd-96f6-97f1cb891098 req-05870eec-ee13-426d-a4d3-4c78700c58a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7bc67af-311c-4441-bd3e-96e8387de26e", "tag": "a31d1086-8cc8-4cdd-8ab6-2db983070eae"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:30.985616 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-5b6ba3ea-fb5b-4dbd-96f6-97f1cb891098 req-05870eec-ee13-426d-a4d3-4c78700c58a6 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:30.986171 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-5b6ba3ea-fb5b-4dbd-96f6-97f1cb891098 req-05870eec-ee13-426d-a4d3-4c78700c58a6 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:30.998111 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-5b6ba3ea-fb5b-4dbd-96f6-97f1cb891098 req-05870eec-ee13-426d-a4d3-4c78700c58a6 service nova] Creating event network-changed:a31d1086-8cc8-4cdd-8ab6-2db983070eae for instance d7bc67af-311c-4441-bd3e-96e8387de26e on hv-cinder-85083 Jul 25 06:01:31.003553 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-5b6ba3ea-fb5b-4dbd-96f6-97f1cb891098 req-05870eec-ee13-426d-a4d3-4c78700c58a6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033901 Jul 25 06:01:31.004159 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 227/453] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:31.246720 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-de6d35c6-a743-4c9a-bd9e-b23f6b6ee53c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:31.247331 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-de6d35c6-a743-4c9a-bd9e-b23f6b6ee53c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:31.253666 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-de6d35c6-a743-4c9a-bd9e-b23f6b6ee53c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:31.254113 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-de6d35c6-a743-4c9a-bd9e-b23f6b6ee53c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:31.254892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-de6d35c6-a743-4c9a-bd9e-b23f6b6ee53c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:31.255320 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-de6d35c6-a743-4c9a-bd9e-b23f6b6ee53c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:31.403658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-de6d35c6-a743-4c9a-bd9e-b23f6b6ee53c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:31.411833 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-de6d35c6-a743-4c9a-bd9e-b23f6b6ee53c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1372 microversion: 2.1 time: 0.168870 Jul 25 06:01:31.416960 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-03c050a8-c60a-4b3f-b587-7cb617318328 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:31.418202 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-03c050a8-c60a-4b3f-b587-7cb617318328 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:31.422391 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 227/454] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:31 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:31.426061 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-03c050a8-c60a-4b3f-b587-7cb617318328 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:31.426582 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-03c050a8-c60a-4b3f-b587-7cb617318328 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:31.427410 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-03c050a8-c60a-4b3f-b587-7cb617318328 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:31.427871 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-03c050a8-c60a-4b3f-b587-7cb617318328 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:31.580658 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-03c050a8-c60a-4b3f-b587-7cb617318328 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:31.589423 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-03c050a8-c60a-4b3f-b587-7cb617318328 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1503 microversion: 2.1 time: 0.178350 Jul 25 06:01:31.590753 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 228/455] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:31 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:31.860056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d9fdf284-9198-4108-b942-7a0ff0699ae3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:31.860696 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d9fdf284-9198-4108-b942-7a0ff0699ae3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:31.868104 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d9fdf284-9198-4108-b942-7a0ff0699ae3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:31.868557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d9fdf284-9198-4108-b942-7a0ff0699ae3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:31.869324 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d9fdf284-9198-4108-b942-7a0ff0699ae3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:31.869763 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d9fdf284-9198-4108-b942-7a0ff0699ae3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:32.012014 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d9fdf284-9198-4108-b942-7a0ff0699ae3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:32.020339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d9fdf284-9198-4108-b942-7a0ff0699ae3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:32.021919 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d9fdf284-9198-4108-b942-7a0ff0699ae3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:32.023266 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d9fdf284-9198-4108-b942-7a0ff0699ae3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1722 microversion: 2.20 time: 0.166997 Jul 25 06:01:32.023818 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 228/456] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:31 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:32.042655 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6a1e7152-409f-40d7-bc58-121c17ac53ba tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c877384-6d8c-451d-a3db-153ff78acced"}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:32.043767 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-6a1e7152-409f-40d7-bc58-121c17ac53ba tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:32.049835 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6a1e7152-409f-40d7-bc58-121c17ac53ba tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:32.050288 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6a1e7152-409f-40d7-bc58-121c17ac53ba tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:32.051262 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6a1e7152-409f-40d7-bc58-121c17ac53ba tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:32.051697 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6a1e7152-409f-40d7-bc58-121c17ac53ba tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:32.431628 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ee8755ac-3031-446c-bf8d-b30bdf25f81a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:32.434197 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ee8755ac-3031-446c-bf8d-b30bdf25f81a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:32.442648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ee8755ac-3031-446c-bf8d-b30bdf25f81a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:32.443887 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ee8755ac-3031-446c-bf8d-b30bdf25f81a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:32.444924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ee8755ac-3031-446c-bf8d-b30bdf25f81a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:32.445944 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ee8755ac-3031-446c-bf8d-b30bdf25f81a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:32.599108 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ee8755ac-3031-446c-bf8d-b30bdf25f81a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:32.607365 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ee8755ac-3031-446c-bf8d-b30bdf25f81a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1372 microversion: 2.1 time: 0.182126 Jul 25 06:01:32.607953 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 229/457] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:32 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:32.613235 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5408088f-6a42-4935-88e7-436e561580cb tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:32.618797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5408088f-6a42-4935-88e7-436e561580cb tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:32.631740 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5408088f-6a42-4935-88e7-436e561580cb tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:32.632770 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5408088f-6a42-4935-88e7-436e561580cb tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:32.633738 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5408088f-6a42-4935-88e7-436e561580cb tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:32.634188 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5408088f-6a42-4935-88e7-436e561580cb tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:32.710054 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5408088f-6a42-4935-88e7-436e561580cb tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:32.718985 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5408088f-6a42-4935-88e7-436e561580cb tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1461 microversion: 2.1 time: 0.109594 Jul 25 06:01:32.719765 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 230/458] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:32 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1461 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:33.018237 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-230ae1b1-372a-43b5-8024-cd8d0932c6fd req-8c98948f-ae70-489c-905c-d5cf578a3d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b34891-1621-4f3a-9da2-a76876d73d9d", "name": "network-vif-deleted", "tag": "6eaf0f0d-7dd9-4355-b116-4148ed1c86ec"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:33.026341 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-230ae1b1-372a-43b5-8024-cd8d0932c6fd req-8c98948f-ae70-489c-905c-d5cf578a3d6a service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:33.026816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-230ae1b1-372a-43b5-8024-cd8d0932c6fd req-8c98948f-ae70-489c-905c-d5cf578a3d6a service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:33.037378 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-230ae1b1-372a-43b5-8024-cd8d0932c6fd req-8c98948f-ae70-489c-905c-d5cf578a3d6a service nova] Creating event network-vif-deleted:6eaf0f0d-7dd9-4355-b116-4148ed1c86ec for instance 57b34891-1621-4f3a-9da2-a76876d73d9d on hv-cinder-85083 Jul 25 06:01:33.043290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-230ae1b1-372a-43b5-8024-cd8d0932c6fd req-8c98948f-ae70-489c-905c-d5cf578a3d6a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028409 Jul 25 06:01:33.044168 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 231/459] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:33.184596 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-abf0fa74-1de1-4570-a819-a71b07d7c80b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-105639181", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2041156438", "security_groups": [{"name": "tempest-secgroup-smoke-740524908"}], "networks": [{"uuid": "aed552fe-ca43-4640-8e89-12eac6083a39"}], "block_device_mapping_v2": [{"uuid": "ad56fab4-8044-493b-9b20-2aa2d1eb10f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:33.193515 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-6a1e7152-409f-40d7-bc58-121c17ac53ba tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "POST /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.155746 Jul 25 06:01:33.199868 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 229/460] 10.222.0.17 () {62 vars in 1363 bytes} [Mon Jul 25 06:01:32 2022] POST /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-volume_attachments => generated 188 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 06:01:33.312500 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1b44a142-4b26-48ec-adbb-f009e346402f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:33.313186 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1b44a142-4b26-48ec-adbb-f009e346402f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:33.320494 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1b44a142-4b26-48ec-adbb-f009e346402f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:33.321116 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1b44a142-4b26-48ec-adbb-f009e346402f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:33.321900 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1b44a142-4b26-48ec-adbb-f009e346402f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:33.322413 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1b44a142-4b26-48ec-adbb-f009e346402f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:33.527456 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.network.neutron [None req-abf0fa74-1de1-4570-a819-a71b07d7c80b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] validate_networks() for [('aed552fe-ca43-4640-8e89-12eac6083a39', None, None, None, None, None)] {{(pid=130163) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:01:33.539355 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1b44a142-4b26-48ec-adbb-f009e346402f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "POST /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/action" status: 202 len: 0 microversion: 2.20 time: 0.229909 Jul 25 06:01:33.540298 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 230/461] 10.222.0.17 () {62 vars in 1318 bytes} [Mon Jul 25 06:01:33 2022] POST /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 06:01:33.548283 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-eda0bc0e-8fc9-43d7-9ae5-8911c00af802 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:33.549095 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-eda0bc0e-8fc9-43d7-9ae5-8911c00af802 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:33.556517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eda0bc0e-8fc9-43d7-9ae5-8911c00af802 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:33.558033 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eda0bc0e-8fc9-43d7-9ae5-8911c00af802 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:33.558033 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eda0bc0e-8fc9-43d7-9ae5-8911c00af802 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:33.558410 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eda0bc0e-8fc9-43d7-9ae5-8911c00af802 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:33.750118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-eda0bc0e-8fc9-43d7-9ae5-8911c00af802 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:33.760776 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-eda0bc0e-8fc9-43d7-9ae5-8911c00af802 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:33.767424 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-eda0bc0e-8fc9-43d7-9ae5-8911c00af802 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:33.769410 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-eda0bc0e-8fc9-43d7-9ae5-8911c00af802 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1748 microversion: 2.20 time: 0.225094 Jul 25 06:01:33.770149 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 231/462] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:33 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1748 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:01:33.785496 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-02887e4c-2094-4079-973b-c92c3c622248 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:33.786285 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-02887e4c-2094-4079-973b-c92c3c622248 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:33.797567 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-02887e4c-2094-4079-973b-c92c3c622248 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:33.798585 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-02887e4c-2094-4079-973b-c92c3c622248 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:33.799694 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-02887e4c-2094-4079-973b-c92c3c622248 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:33.800442 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-02887e4c-2094-4079-973b-c92c3c622248 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:33.948056 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-02887e4c-2094-4079-973b-c92c3c622248 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:33.956169 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-02887e4c-2094-4079-973b-c92c3c622248 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1372 microversion: 2.1 time: 0.184505 Jul 25 06:01:33.956823 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 232/463] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:33 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:33.962430 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1784713c-503b-487e-8c07-0ca0b668741e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:33.963139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1784713c-503b-487e-8c07-0ca0b668741e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:33.969415 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1784713c-503b-487e-8c07-0ca0b668741e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:33.969869 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1784713c-503b-487e-8c07-0ca0b668741e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:33.970649 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1784713c-503b-487e-8c07-0ca0b668741e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:33.971076 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1784713c-503b-487e-8c07-0ca0b668741e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:33.980631 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-abf0fa74-1de1-4570-a819-a71b07d7c80b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Flavor limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:01:33.981056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-abf0fa74-1de1-4570-a819-a71b07d7c80b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Image limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:01:33.981691 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-abf0fa74-1de1-4570-a819-a71b07d7c80b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Flavor pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:01:33.982128 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-abf0fa74-1de1-4570-a819-a71b07d7c80b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Image pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:01:33.982576 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-abf0fa74-1de1-4570-a819-a71b07d7c80b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:01:33.991255 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-abf0fa74-1de1-4570-a819-a71b07d7c80b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:33.991744 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-abf0fa74-1de1-4570-a819-a71b07d7c80b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:33.992536 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-abf0fa74-1de1-4570-a819-a71b07d7c80b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:33.992970 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-abf0fa74-1de1-4570-a819-a71b07d7c80b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:34.004053 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1784713c-503b-487e-8c07-0ca0b668741e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:34.004496 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1784713c-503b-487e-8c07-0ca0b668741e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:34.004936 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-1784713c-503b-487e-8c07-0ca0b668741e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lazy-loading 'fault' on Instance uuid 57b34891-1621-4f3a-9da2-a76876d73d9d {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:01:34.010842 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-abf0fa74-1de1-4570-a819-a71b07d7c80b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Getting quotas for project 52a1423a26e041959827c5d8611cffdf. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:01:34.014841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-abf0fa74-1de1-4570-a819-a71b07d7c80b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Getting quotas for user d03b404df6d54b638804804bbc08e1cf and project 52a1423a26e041959827c5d8611cffdf. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:01:34.047108 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1784713c-503b-487e-8c07-0ca0b668741e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01061da6fc0404facce47e669ec80af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011cdb0f00b9444c812ac101bc5b43e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:34.054616 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1784713c-503b-487e-8c07-0ca0b668741e tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 200 len: 1304 microversion: 2.1 time: 0.096443 Jul 25 06:01:34.055183 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 233/464] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:33 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:34.076752 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-abf0fa74-1de1-4570-a819-a71b07d7c80b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Going to run 1 instances... {{(pid=130163) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:01:34.079018 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-abf0fa74-1de1-4570-a819-a71b07d7c80b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ad56fab4-8044-493b-9b20-2aa2d1eb10f7',volume_size=None,volume_type=None)] {{(pid=130163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:01:34.477586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-abf0fa74-1de1-4570-a819-a71b07d7c80b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.297093 Jul 25 06:01:34.478530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 232/465] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 06:01:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 06:01:34.488999 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-adf5601d-0334-4bb0-a56f-ed2ac44fe119 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:34.489723 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-adf5601d-0334-4bb0-a56f-ed2ac44fe119 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:34.576363 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-adf5601d-0334-4bb0-a56f-ed2ac44fe119 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:34.585033 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-adf5601d-0334-4bb0-a56f-ed2ac44fe119 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1088 microversion: 2.1 time: 0.100349 Jul 25 06:01:34.585735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 234/466] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:34 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1088 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:34.789699 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7da4641e-899f-4710-8ec2-10f71b28f360 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:34.790987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7da4641e-899f-4710-8ec2-10f71b28f360 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:34.797621 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7da4641e-899f-4710-8ec2-10f71b28f360 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:34.797980 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7da4641e-899f-4710-8ec2-10f71b28f360 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:34.798804 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7da4641e-899f-4710-8ec2-10f71b28f360 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:34.799248 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7da4641e-899f-4710-8ec2-10f71b28f360 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:34.844385 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9f117724-4ce6-4301-86d5-1c764171a6de tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:34.844882 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-9f117724-4ce6-4301-86d5-1c764171a6de tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:34.855516 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9f117724-4ce6-4301-86d5-1c764171a6de tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:34.857660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9f117724-4ce6-4301-86d5-1c764171a6de tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:34.857660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9f117724-4ce6-4301-86d5-1c764171a6de tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:34.857660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9f117724-4ce6-4301-86d5-1c764171a6de tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:34.890433 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:35.013650 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-9f117724-4ce6-4301-86d5-1c764171a6de tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lazy-loading 'services' on Instance uuid 7e42471b-2518-4844-b7de-4e14e425fe2c {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:01:35.015878 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7da4641e-899f-4710-8ec2-10f71b28f360 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:35.026515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7da4641e-899f-4710-8ec2-10f71b28f360 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:35.031315 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7da4641e-899f-4710-8ec2-10f71b28f360 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:35.031315 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-7da4641e-899f-4710-8ec2-10f71b28f360 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1748 microversion: 2.20 time: 0.244527 Jul 25 06:01:35.031315 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 233/467] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:34 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1748 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:35.045612 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e2deb455-fcd7-43fe-92d7-5b48b3aca20a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:35.046316 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e2deb455-fcd7-43fe-92d7-5b48b3aca20a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:35.057372 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e2deb455-fcd7-43fe-92d7-5b48b3aca20a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:35.057969 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e2deb455-fcd7-43fe-92d7-5b48b3aca20a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:35.058962 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e2deb455-fcd7-43fe-92d7-5b48b3aca20a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:35.059468 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e2deb455-fcd7-43fe-92d7-5b48b3aca20a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:35.264405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e2deb455-fcd7-43fe-92d7-5b48b3aca20a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:35.272008 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e2deb455-fcd7-43fe-92d7-5b48b3aca20a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1372 microversion: 2.1 time: 0.239699 Jul 25 06:01:35.272587 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 234/468] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:35 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1372 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:35.278275 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-47151269-9d69-4d54-859e-53eafb584cb6 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:35.278921 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-47151269-9d69-4d54-859e-53eafb584cb6 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] [instance: 57b34891-1621-4f3a-9da2-a76876d73d9d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:35.285637 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-47151269-9d69-4d54-859e-53eafb584cb6 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:35.286092 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-47151269-9d69-4d54-859e-53eafb584cb6 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:35.298903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-47151269-9d69-4d54-859e-53eafb584cb6 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:35.298903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-47151269-9d69-4d54-859e-53eafb584cb6 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:35.299141 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-9f117724-4ce6-4301-86d5-1c764171a6de tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c/os-volume_attachments/b9d6a6d5-8ea6-4ea6-9600-538940dcc72d" status: 202 len: 0 microversion: 2.1 time: 0.450887 Jul 25 06:01:35.299141 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 235/469] 10.222.0.17 () {58 vars in 1415 bytes} [Mon Jul 25 06:01:34 2022] DELETE /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c/os-volume_attachments/b9d6a6d5-8ea6-4ea6-9600-538940dcc72d => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 06:01:35.302898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-47151269-9d69-4d54-859e-53eafb584cb6 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] HTTP exception thrown: Instance 57b34891-1621-4f3a-9da2-a76876d73d9d could not be found. Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-47151269-9d69-4d54-859e-53eafb584cb6 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Request method failure captured: Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d HTTP/1.1 Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jF8uVwkC3xv6JIfE8yRIhTseoIA9wWKW9W6bbqZIPT-EVWHmqStV4pXI26q34wDBcAXz6YCFz9yOu592K6tkfNkpzr6JrqfylVH74GofbV-4HqBSlj5mQkbhN1L-kS7nEYzcOmaarnsQUz0HXeua6b27e972BPCNgBUKH0xtNwOkLo Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 011cdb0f00b9444c812ac101bc5b43e3 Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-VolumesActionsTest-1933252008 Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:01:35.304557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:01:35.305901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/011cdb0f00b9444c812ac101bc5b43e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/011cdb0f00b9444c812ac101bc5b43e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/011cdb0f00b9444c812ac101bc5b43e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_011cdb0f00b9444c812ac101bc5b43e3", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:01:35.305901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-VolumesActionsTest-1933252008 Jul 25 06:01:35.305901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 011cdb0f00b9444c812ac101bc5b43e3 Jul 25 06:01:35.305901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-VolumesActionsTest-1933252008 Jul 25 06:01:35.305901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-VolumesActionsTest-1933252008-project Jul 25 06:01:35.305901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:01:35.305901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:01:35.305901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: a01061da6fc0404facce47e669ec80af Jul 25 06:01:35.305901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-VolumesActionsTest-1933252008-project Jul 25 06:01:35.305901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:01:35.305901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 57b34891-1621-4f3a-9da2-a76876d73d9d could not be found. Jul 25 06:01:35.305901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '57b34891-1621-4f3a-9da2-a76876d73d9d'} Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b34891-1621-4f3a-9da2-a76876d73d9d could not be found. Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:01:35.306987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b34891-1621-4f3a-9da2-a76876d73d9d could not be found. Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b34891-1621-4f3a-9da2-a76876d73d9d could not be found. Jul 25 06:01:35.308198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:01:35.309273 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-47151269-9d69-4d54-859e-53eafb584cb6 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] Returning 404 to user: Instance 57b34891-1621-4f3a-9da2-a76876d73d9d could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:01:35.309273 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-47151269-9d69-4d54-859e-53eafb584cb6 tempest-VolumesActionsTest-1933252008 tempest-VolumesActionsTest-1933252008-project] 10.222.0.17 "GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d" status: 404 len: 111 microversion: 2.1 time: 0.031291 Jul 25 06:01:35.309273 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 235/470] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:35 2022] GET /compute/v2.1/servers/57b34891-1621-4f3a-9da2-a76876d73d9d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:01:35.602080 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-4bca9849-c417-4b0c-8ca1-bbaefd57aebe tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:35.602892 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-4bca9849-c417-4b0c-8ca1-bbaefd57aebe tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:35.666069 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4bca9849-c417-4b0c-8ca1-bbaefd57aebe tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:35.676283 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-4bca9849-c417-4b0c-8ca1-bbaefd57aebe tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1088 microversion: 2.1 time: 0.078846 Jul 25 06:01:35.685123 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 236/471] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:35 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:36.048361 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4cc3f29e-2935-48fc-8635-715220875e73 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:36.048973 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4cc3f29e-2935-48fc-8635-715220875e73 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:36.055987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4cc3f29e-2935-48fc-8635-715220875e73 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:36.056430 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4cc3f29e-2935-48fc-8635-715220875e73 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:36.057195 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4cc3f29e-2935-48fc-8635-715220875e73 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:36.057626 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4cc3f29e-2935-48fc-8635-715220875e73 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:36.203564 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4cc3f29e-2935-48fc-8635-715220875e73 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:36.212377 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4cc3f29e-2935-48fc-8635-715220875e73 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:36.214934 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4cc3f29e-2935-48fc-8635-715220875e73 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:36.215149 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4cc3f29e-2935-48fc-8635-715220875e73 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1750 microversion: 2.20 time: 0.170724 Jul 25 06:01:36.216018 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 236/472] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:36 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1750 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:36.291921 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cbe635d8-9786-4563-b55f-1b02da865026 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:36.294189 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-cbe635d8-9786-4563-b55f-1b02da865026 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:36.305647 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cbe635d8-9786-4563-b55f-1b02da865026 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:36.306097 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cbe635d8-9786-4563-b55f-1b02da865026 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:36.306905 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cbe635d8-9786-4563-b55f-1b02da865026 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:36.307336 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cbe635d8-9786-4563-b55f-1b02da865026 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:36.485441 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cbe635d8-9786-4563-b55f-1b02da865026 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:36.493416 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-cbe635d8-9786-4563-b55f-1b02da865026 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1372 microversion: 2.1 time: 0.208081 Jul 25 06:01:36.493987 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 237/473] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:36 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:36.692496 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-34fc50a6-f68f-4c05-936b-047caf78552d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:36.693110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-34fc50a6-f68f-4c05-936b-047caf78552d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:36.700106 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-34fc50a6-f68f-4c05-936b-047caf78552d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:36.700803 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-34fc50a6-f68f-4c05-936b-047caf78552d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:36.701744 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-34fc50a6-f68f-4c05-936b-047caf78552d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:36.702337 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-34fc50a6-f68f-4c05-936b-047caf78552d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:36.765870 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-34fc50a6-f68f-4c05-936b-047caf78552d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:36.775198 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-34fc50a6-f68f-4c05-936b-047caf78552d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1130 microversion: 2.1 time: 0.086430 Jul 25 06:01:36.775770 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 237/474] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:36 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1130 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:37.233295 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-408bce4f-1ff1-433f-90a7-90747aade61a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:37.234021 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-408bce4f-1ff1-433f-90a7-90747aade61a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:37.240289 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-408bce4f-1ff1-433f-90a7-90747aade61a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:37.240729 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-408bce4f-1ff1-433f-90a7-90747aade61a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:37.241554 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-408bce4f-1ff1-433f-90a7-90747aade61a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:37.242014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-408bce4f-1ff1-433f-90a7-90747aade61a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:37.382052 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-408bce4f-1ff1-433f-90a7-90747aade61a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:37.391211 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-408bce4f-1ff1-433f-90a7-90747aade61a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:37.392720 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-408bce4f-1ff1-433f-90a7-90747aade61a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:37.393866 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-408bce4f-1ff1-433f-90a7-90747aade61a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1750 microversion: 2.20 time: 0.164619 Jul 25 06:01:37.394557 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 238/475] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:37 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:37.511139 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8eb6b3f3-62ff-4913-ac0b-1092de08f907 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:37.511633 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8eb6b3f3-62ff-4913-ac0b-1092de08f907 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:37.517668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8eb6b3f3-62ff-4913-ac0b-1092de08f907 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:37.518113 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8eb6b3f3-62ff-4913-ac0b-1092de08f907 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:37.518892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8eb6b3f3-62ff-4913-ac0b-1092de08f907 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:37.519325 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8eb6b3f3-62ff-4913-ac0b-1092de08f907 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:37.525573 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-05a6a369-0e83-4407-a074-9dd65c74e391 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:37.526077 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-05a6a369-0e83-4407-a074-9dd65c74e391 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:37.531995 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-05a6a369-0e83-4407-a074-9dd65c74e391 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:37.532465 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-05a6a369-0e83-4407-a074-9dd65c74e391 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:37.537378 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-05a6a369-0e83-4407-a074-9dd65c74e391 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:37.537378 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-05a6a369-0e83-4407-a074-9dd65c74e391 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:37.559300 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-05a6a369-0e83-4407-a074-9dd65c74e391 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Going to try to terminate instance {{(pid=130162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:01:37.700967 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8eb6b3f3-62ff-4913-ac0b-1092de08f907 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:37.708671 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8eb6b3f3-62ff-4913-ac0b-1092de08f907 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1372 microversion: 2.1 time: 0.202335 Jul 25 06:01:37.709329 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 238/476] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:37 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1372 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:37.793035 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f025fe0c-b672-4c4e-8ef0-a04f89e9d3f7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:37.793645 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f025fe0c-b672-4c4e-8ef0-a04f89e9d3f7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:37.799563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f025fe0c-b672-4c4e-8ef0-a04f89e9d3f7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:37.800010 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f025fe0c-b672-4c4e-8ef0-a04f89e9d3f7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:37.800761 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f025fe0c-b672-4c4e-8ef0-a04f89e9d3f7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:37.801193 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f025fe0c-b672-4c4e-8ef0-a04f89e9d3f7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:37.832160 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-05a6a369-0e83-4407-a074-9dd65c74e391 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 204 len: 0 microversion: 2.1 time: 0.310144 Jul 25 06:01:37.833025 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 239/477] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:01:37 2022] DELETE /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 06:01:37.841195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-efbbcd15-d618-49fe-89ff-6c965bc56834 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:37.842139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-efbbcd15-d618-49fe-89ff-6c965bc56834 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:37.848088 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-efbbcd15-d618-49fe-89ff-6c965bc56834 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:37.848531 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-efbbcd15-d618-49fe-89ff-6c965bc56834 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:37.849317 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-efbbcd15-d618-49fe-89ff-6c965bc56834 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:37.849740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-efbbcd15-d618-49fe-89ff-6c965bc56834 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:37.880777 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f025fe0c-b672-4c4e-8ef0-a04f89e9d3f7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:37.898667 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f025fe0c-b672-4c4e-8ef0-a04f89e9d3f7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1186 microversion: 2.1 time: 0.109982 Jul 25 06:01:37.899617 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 239/478] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:37 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1186 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:38.062975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-efbbcd15-d618-49fe-89ff-6c965bc56834 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:38.071043 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-efbbcd15-d618-49fe-89ff-6c965bc56834 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1515 microversion: 2.1 time: 0.233872 Jul 25 06:01:38.072153 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 240/479] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:37 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:38.416989 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-31152ab4-0096-48e4-b8f2-f2be852b737d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:38.418566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-31152ab4-0096-48e4-b8f2-f2be852b737d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:38.423810 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-31152ab4-0096-48e4-b8f2-f2be852b737d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:38.424312 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-31152ab4-0096-48e4-b8f2-f2be852b737d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:38.425082 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-31152ab4-0096-48e4-b8f2-f2be852b737d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:38.425525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-31152ab4-0096-48e4-b8f2-f2be852b737d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:38.559940 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-31152ab4-0096-48e4-b8f2-f2be852b737d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:38.568858 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-31152ab4-0096-48e4-b8f2-f2be852b737d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:38.571205 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-31152ab4-0096-48e4-b8f2-f2be852b737d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:38.572365 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-31152ab4-0096-48e4-b8f2-f2be852b737d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1750 microversion: 2.20 time: 0.160401 Jul 25 06:01:38.572919 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 240/480] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:38 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1750 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:38.724941 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ea72d5ae-e63a-4ae4-be28-8f9210677d04 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:38.725559 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ea72d5ae-e63a-4ae4-be28-8f9210677d04 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:38.732218 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ea72d5ae-e63a-4ae4-be28-8f9210677d04 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:38.732666 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ea72d5ae-e63a-4ae4-be28-8f9210677d04 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:38.733427 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ea72d5ae-e63a-4ae4-be28-8f9210677d04 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:38.733920 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ea72d5ae-e63a-4ae4-be28-8f9210677d04 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:38.868357 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ea72d5ae-e63a-4ae4-be28-8f9210677d04 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:38.878822 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ea72d5ae-e63a-4ae4-be28-8f9210677d04 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1372 microversion: 2.1 time: 0.157350 Jul 25 06:01:38.879408 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 241/481] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:38 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:38.915377 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e7f24133-e2ac-4258-8a47-8b3fad0400c3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:38.915999 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e7f24133-e2ac-4258-8a47-8b3fad0400c3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:38.922066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e7f24133-e2ac-4258-8a47-8b3fad0400c3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:38.922563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e7f24133-e2ac-4258-8a47-8b3fad0400c3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:38.923328 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e7f24133-e2ac-4258-8a47-8b3fad0400c3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:38.923766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e7f24133-e2ac-4258-8a47-8b3fad0400c3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:38.989682 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e7f24133-e2ac-4258-8a47-8b3fad0400c3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:38.997669 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e7f24133-e2ac-4258-8a47-8b3fad0400c3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1186 microversion: 2.1 time: 0.086604 Jul 25 06:01:38.998411 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 241/482] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:38 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:39.088449 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-842f8614-0bef-4eb1-90e8-e88c676baab3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:39.089092 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-842f8614-0bef-4eb1-90e8-e88c676baab3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:39.095120 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-842f8614-0bef-4eb1-90e8-e88c676baab3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:39.095565 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-842f8614-0bef-4eb1-90e8-e88c676baab3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:39.096324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-842f8614-0bef-4eb1-90e8-e88c676baab3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:39.096753 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-842f8614-0bef-4eb1-90e8-e88c676baab3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:39.232721 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-842f8614-0bef-4eb1-90e8-e88c676baab3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:39.240204 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-842f8614-0bef-4eb1-90e8-e88c676baab3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1515 microversion: 2.1 time: 0.155582 Jul 25 06:01:39.240768 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 242/483] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:39 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:39.589939 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-219f9301-ad7e-49d0-9ad3-47a7371bf7ad tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:39.590545 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-219f9301-ad7e-49d0-9ad3-47a7371bf7ad tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:39.597177 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-219f9301-ad7e-49d0-9ad3-47a7371bf7ad tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:39.597514 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-219f9301-ad7e-49d0-9ad3-47a7371bf7ad tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:39.598272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-219f9301-ad7e-49d0-9ad3-47a7371bf7ad tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:39.598732 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-219f9301-ad7e-49d0-9ad3-47a7371bf7ad tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:39.729832 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-219f9301-ad7e-49d0-9ad3-47a7371bf7ad tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:39.738825 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-219f9301-ad7e-49d0-9ad3-47a7371bf7ad tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:39.740388 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-219f9301-ad7e-49d0-9ad3-47a7371bf7ad tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:39.741659 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-219f9301-ad7e-49d0-9ad3-47a7371bf7ad tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1750 microversion: 2.20 time: 0.155707 Jul 25 06:01:39.742215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 242/484] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:39 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:39.903255 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b3262244-a9e5-4f00-b73c-35446924e233 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:39.903871 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b3262244-a9e5-4f00-b73c-35446924e233 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:39.910745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b3262244-a9e5-4f00-b73c-35446924e233 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:39.910874 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b3262244-a9e5-4f00-b73c-35446924e233 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:39.911587 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b3262244-a9e5-4f00-b73c-35446924e233 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:39.912024 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b3262244-a9e5-4f00-b73c-35446924e233 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:40.047490 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b3262244-a9e5-4f00-b73c-35446924e233 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:40.056181 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b3262244-a9e5-4f00-b73c-35446924e233 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1372 microversion: 2.1 time: 0.156676 Jul 25 06:01:40.056797 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 243/485] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:39 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:40.072392 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-67d8203b-287c-4326-a44a-8387c06436a8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:40.073037 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-67d8203b-287c-4326-a44a-8387c06436a8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:40.079410 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-67d8203b-287c-4326-a44a-8387c06436a8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:40.079856 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-67d8203b-287c-4326-a44a-8387c06436a8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:40.080707 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-67d8203b-287c-4326-a44a-8387c06436a8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:40.081142 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-67d8203b-287c-4326-a44a-8387c06436a8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:40.151176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-67d8203b-287c-4326-a44a-8387c06436a8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:40.154595 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-67d8203b-287c-4326-a44a-8387c06436a8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1194 microversion: 2.1 time: 0.086831 Jul 25 06:01:40.155164 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 243/486] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:40 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:40.257169 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-485c47f9-0a49-4128-b9c7-7423dda82c16 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:40.258282 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-485c47f9-0a49-4128-b9c7-7423dda82c16 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:40.264323 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-485c47f9-0a49-4128-b9c7-7423dda82c16 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:40.264768 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-485c47f9-0a49-4128-b9c7-7423dda82c16 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:40.265522 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-485c47f9-0a49-4128-b9c7-7423dda82c16 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:40.265949 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-485c47f9-0a49-4128-b9c7-7423dda82c16 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:40.411191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-485c47f9-0a49-4128-b9c7-7423dda82c16 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:40.419262 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-485c47f9-0a49-4128-b9c7-7423dda82c16 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1515 microversion: 2.1 time: 0.165924 Jul 25 06:01:40.422608 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 244/487] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:40 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:40.759764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-11947ea6-dd46-48e7-97c9-d2ef2d6393c7 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:40.760302 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-11947ea6-dd46-48e7-97c9-d2ef2d6393c7 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:40.766724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-11947ea6-dd46-48e7-97c9-d2ef2d6393c7 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:40.767178 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-11947ea6-dd46-48e7-97c9-d2ef2d6393c7 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:40.767928 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-11947ea6-dd46-48e7-97c9-d2ef2d6393c7 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:40.768360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-11947ea6-dd46-48e7-97c9-d2ef2d6393c7 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:40.786579 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=100 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:40.897058 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-11947ea6-dd46-48e7-97c9-d2ef2d6393c7 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:40.906344 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-11947ea6-dd46-48e7-97c9-d2ef2d6393c7 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:40.907903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-11947ea6-dd46-48e7-97c9-d2ef2d6393c7 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:40.909105 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-11947ea6-dd46-48e7-97c9-d2ef2d6393c7 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1750 microversion: 2.20 time: 0.153396 Jul 25 06:01:40.909661 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 244/488] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:40 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:01:41.073426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-20acb788-f612-4b9d-825d-fe85ae9dfffc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:41.074059 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-20acb788-f612-4b9d-825d-fe85ae9dfffc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:41.080573 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-20acb788-f612-4b9d-825d-fe85ae9dfffc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:41.081092 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-20acb788-f612-4b9d-825d-fe85ae9dfffc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:41.081855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-20acb788-f612-4b9d-825d-fe85ae9dfffc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:41.082289 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-20acb788-f612-4b9d-825d-fe85ae9dfffc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:41.173931 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-48fd81a0-b83d-4ec3-9a8a-b87c620aa9e8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:41.174593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-48fd81a0-b83d-4ec3-9a8a-b87c620aa9e8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:41.181109 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-48fd81a0-b83d-4ec3-9a8a-b87c620aa9e8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:41.181813 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-48fd81a0-b83d-4ec3-9a8a-b87c620aa9e8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:41.182646 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-48fd81a0-b83d-4ec3-9a8a-b87c620aa9e8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:41.183075 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-48fd81a0-b83d-4ec3-9a8a-b87c620aa9e8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:41.225311 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-20acb788-f612-4b9d-825d-fe85ae9dfffc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:41.233645 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-20acb788-f612-4b9d-825d-fe85ae9dfffc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1372 microversion: 2.1 time: 0.163991 Jul 25 06:01:41.242807 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 245/489] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:41 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:41.266783 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-48fd81a0-b83d-4ec3-9a8a-b87c620aa9e8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:41.274888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-48fd81a0-b83d-4ec3-9a8a-b87c620aa9e8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1194 microversion: 2.1 time: 0.106392 Jul 25 06:01:41.278911 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 245/490] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:41 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1194 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:41.435963 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e60a13d2-5c68-40ae-89f0-6a17b2841b40 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:41.436573 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e60a13d2-5c68-40ae-89f0-6a17b2841b40 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:41.443097 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e60a13d2-5c68-40ae-89f0-6a17b2841b40 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:41.447137 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e60a13d2-5c68-40ae-89f0-6a17b2841b40 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:41.447137 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e60a13d2-5c68-40ae-89f0-6a17b2841b40 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:41.447137 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e60a13d2-5c68-40ae-89f0-6a17b2841b40 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:41.747161 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e60a13d2-5c68-40ae-89f0-6a17b2841b40 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:41.756867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e60a13d2-5c68-40ae-89f0-6a17b2841b40 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1515 microversion: 2.1 time: 0.324653 Jul 25 06:01:41.761039 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 246/491] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:41 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1515 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:41.934415 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9d6ba5a1-3f1e-407b-9e12-0ad27d3bfe28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:41.936460 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-9d6ba5a1-3f1e-407b-9e12-0ad27d3bfe28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:41.943223 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:41.963323 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9d6ba5a1-3f1e-407b-9e12-0ad27d3bfe28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:41.963768 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9d6ba5a1-3f1e-407b-9e12-0ad27d3bfe28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:41.969814 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9d6ba5a1-3f1e-407b-9e12-0ad27d3bfe28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:41.970274 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9d6ba5a1-3f1e-407b-9e12-0ad27d3bfe28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:42.250355 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9d3fdd6a-3ec2-4ae9-a838-c963c1ac785b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:42.250991 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-9d3fdd6a-3ec2-4ae9-a838-c963c1ac785b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:42.264330 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9d3fdd6a-3ec2-4ae9-a838-c963c1ac785b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:42.265300 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9d3fdd6a-3ec2-4ae9-a838-c963c1ac785b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:42.268293 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9d3fdd6a-3ec2-4ae9-a838-c963c1ac785b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:42.269436 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9d3fdd6a-3ec2-4ae9-a838-c963c1ac785b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:42.354514 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9d6ba5a1-3f1e-407b-9e12-0ad27d3bfe28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:42.374440 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9d6ba5a1-3f1e-407b-9e12-0ad27d3bfe28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:42.374440 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9d6ba5a1-3f1e-407b-9e12-0ad27d3bfe28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:42.374717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9d6ba5a1-3f1e-407b-9e12-0ad27d3bfe28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1750 microversion: 2.20 time: 0.449644 Jul 25 06:01:42.386081 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 246/492] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:41 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1750 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:42.393755 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-45277c91-d268-4daa-9cda-b5ef61acd47d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:42.394381 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-45277c91-d268-4daa-9cda-b5ef61acd47d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:42.404243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-45277c91-d268-4daa-9cda-b5ef61acd47d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:42.407732 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-45277c91-d268-4daa-9cda-b5ef61acd47d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:42.407732 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-45277c91-d268-4daa-9cda-b5ef61acd47d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:42.407732 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-45277c91-d268-4daa-9cda-b5ef61acd47d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:42.516680 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-45277c91-d268-4daa-9cda-b5ef61acd47d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:42.526815 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-45277c91-d268-4daa-9cda-b5ef61acd47d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1204 microversion: 2.1 time: 0.137875 Jul 25 06:01:42.528343 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 247/493] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:42 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1204 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:42.534225 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-6bd53f06-5c8a-4d4e-a06b-edacfe7b246e req-f7870316-2f06-4ce6-9b17-a7dbf4aec161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7bc67af-311c-4441-bd3e-96e8387de26e", "name": "network-vif-plugged", "status": "completed", "tag": "a31d1086-8cc8-4cdd-8ab6-2db983070eae"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:42.547959 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-6bd53f06-5c8a-4d4e-a06b-edacfe7b246e req-f7870316-2f06-4ce6-9b17-a7dbf4aec161 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:42.548747 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-6bd53f06-5c8a-4d4e-a06b-edacfe7b246e req-f7870316-2f06-4ce6-9b17-a7dbf4aec161 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:42.566179 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-6bd53f06-5c8a-4d4e-a06b-edacfe7b246e req-f7870316-2f06-4ce6-9b17-a7dbf4aec161 service nova] Creating event network-vif-plugged:a31d1086-8cc8-4cdd-8ab6-2db983070eae for instance d7bc67af-311c-4441-bd3e-96e8387de26e on hv-cinder-85083 Jul 25 06:01:42.574159 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-6bd53f06-5c8a-4d4e-a06b-edacfe7b246e req-f7870316-2f06-4ce6-9b17-a7dbf4aec161 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044070 Jul 25 06:01:42.575319 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 248/494] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:42.782627 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-99b1befa-a841-44f2-8dcb-96096dd7eef1 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:42.783446 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-99b1befa-a841-44f2-8dcb-96096dd7eef1 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:42.811976 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-99b1befa-a841-44f2-8dcb-96096dd7eef1 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:42.812448 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-99b1befa-a841-44f2-8dcb-96096dd7eef1 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:42.817637 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-99b1befa-a841-44f2-8dcb-96096dd7eef1 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:42.818592 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-99b1befa-a841-44f2-8dcb-96096dd7eef1 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:43.077336 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-99b1befa-a841-44f2-8dcb-96096dd7eef1 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:43.080138 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-99b1befa-a841-44f2-8dcb-96096dd7eef1 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1515 microversion: 2.1 time: 0.301975 Jul 25 06:01:43.081057 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 249/495] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:42 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1515 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:43.123220 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-9d3fdd6a-3ec2-4ae9-a838-c963c1ac785b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:43.131198 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-9d3fdd6a-3ec2-4ae9-a838-c963c1ac785b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1372 microversion: 2.1 time: 0.884610 Jul 25 06:01:43.141863 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 247/496] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:42 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1372 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:43.393348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-eb35f576-49a7-42e3-b723-a62d3ed22545 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:43.393938 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-eb35f576-49a7-42e3-b723-a62d3ed22545 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:43.400773 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-eb35f576-49a7-42e3-b723-a62d3ed22545 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:43.408669 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-eb35f576-49a7-42e3-b723-a62d3ed22545 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:43.409632 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-eb35f576-49a7-42e3-b723-a62d3ed22545 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:43.410125 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-eb35f576-49a7-42e3-b723-a62d3ed22545 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:43.551552 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cd0744c2-d7c1-4b3f-959d-fee70a7f230e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:43.552852 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-cd0744c2-d7c1-4b3f-959d-fee70a7f230e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:43.562015 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd0744c2-d7c1-4b3f-959d-fee70a7f230e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:43.562735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd0744c2-d7c1-4b3f-959d-fee70a7f230e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:43.563846 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd0744c2-d7c1-4b3f-959d-fee70a7f230e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:43.564446 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd0744c2-d7c1-4b3f-959d-fee70a7f230e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:43.705991 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-eb35f576-49a7-42e3-b723-a62d3ed22545 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:43.724318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-eb35f576-49a7-42e3-b723-a62d3ed22545 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:43.731719 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-eb35f576-49a7-42e3-b723-a62d3ed22545 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:43.735023 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-eb35f576-49a7-42e3-b723-a62d3ed22545 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.346223 Jul 25 06:01:43.751813 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 250/497] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:43 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:43.819631 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cd0744c2-d7c1-4b3f-959d-fee70a7f230e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:43.830139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-cd0744c2-d7c1-4b3f-959d-fee70a7f230e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1204 microversion: 2.1 time: 0.288442 Jul 25 06:01:43.831177 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 248/498] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:43 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1204 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:43.868121 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-40b88dca-72d3-42d5-8d7f-76b88e2d7411 req-e260cf2d-f232-4276-bd85-c9ba3623db9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e42471b-2518-4844-b7de-4e14e425fe2c", "name": "network-vif-deleted", "tag": "de782dca-40d1-4006-9734-4aa7b02fecdd"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:43.885079 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-40b88dca-72d3-42d5-8d7f-76b88e2d7411 req-e260cf2d-f232-4276-bd85-c9ba3623db9c service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:43.886175 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-40b88dca-72d3-42d5-8d7f-76b88e2d7411 req-e260cf2d-f232-4276-bd85-c9ba3623db9c service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:43.918923 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-40b88dca-72d3-42d5-8d7f-76b88e2d7411 req-e260cf2d-f232-4276-bd85-c9ba3623db9c service nova] Creating event network-vif-deleted:de782dca-40d1-4006-9734-4aa7b02fecdd for instance 7e42471b-2518-4844-b7de-4e14e425fe2c on hv-cinder-85083 Jul 25 06:01:43.925160 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-40b88dca-72d3-42d5-8d7f-76b88e2d7411 req-e260cf2d-f232-4276-bd85-c9ba3623db9c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061354 Jul 25 06:01:43.925981 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 251/499] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:44.100575 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-768bb791-a6cd-4291-8fbe-6a89684b5a58 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:44.108458 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-768bb791-a6cd-4291-8fbe-6a89684b5a58 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:44.109445 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-768bb791-a6cd-4291-8fbe-6a89684b5a58 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:44.109902 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-768bb791-a6cd-4291-8fbe-6a89684b5a58 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:44.110854 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-768bb791-a6cd-4291-8fbe-6a89684b5a58 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:44.111341 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-768bb791-a6cd-4291-8fbe-6a89684b5a58 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:44.147378 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=2 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:44.148862 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=6 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:44.153087 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-dc0b020b-96f0-4385-89cc-9762364c08e7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:44.153733 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-dc0b020b-96f0-4385-89cc-9762364c08e7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:44.168544 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dc0b020b-96f0-4385-89cc-9762364c08e7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:44.169004 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dc0b020b-96f0-4385-89cc-9762364c08e7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:44.175398 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dc0b020b-96f0-4385-89cc-9762364c08e7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:44.175963 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dc0b020b-96f0-4385-89cc-9762364c08e7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:44.393556 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-768bb791-a6cd-4291-8fbe-6a89684b5a58 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:44.402672 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-768bb791-a6cd-4291-8fbe-6a89684b5a58 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1473 microversion: 2.1 time: 0.307409 Jul 25 06:01:44.404260 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 249/500] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:44 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1473 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:44.525036 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-dc0b020b-96f0-4385-89cc-9762364c08e7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:44.540308 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-dc0b020b-96f0-4385-89cc-9762364c08e7 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1372 microversion: 2.1 time: 0.394187 Jul 25 06:01:44.541215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 252/501] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:44 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1372 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:44.766627 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-28d9e2bb-9a07-480a-8e04-057f2732ebee tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:44.767292 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-28d9e2bb-9a07-480a-8e04-057f2732ebee tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:44.782659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28d9e2bb-9a07-480a-8e04-057f2732ebee tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:44.783331 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28d9e2bb-9a07-480a-8e04-057f2732ebee tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:44.784357 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28d9e2bb-9a07-480a-8e04-057f2732ebee tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:44.784977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28d9e2bb-9a07-480a-8e04-057f2732ebee tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:44.844912 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:44.852578 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-611e20b5-9b63-4173-b1c9-ba1f43d286e7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:44.853174 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-611e20b5-9b63-4173-b1c9-ba1f43d286e7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:44.865376 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-611e20b5-9b63-4173-b1c9-ba1f43d286e7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:44.870842 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-611e20b5-9b63-4173-b1c9-ba1f43d286e7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:44.870842 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-611e20b5-9b63-4173-b1c9-ba1f43d286e7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:44.874089 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-611e20b5-9b63-4173-b1c9-ba1f43d286e7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:45.118365 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-28d9e2bb-9a07-480a-8e04-057f2732ebee tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:45.131181 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-611e20b5-9b63-4173-b1c9-ba1f43d286e7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:45.137169 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-28d9e2bb-9a07-480a-8e04-057f2732ebee tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:45.140038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-28d9e2bb-9a07-480a-8e04-057f2732ebee tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:45.143860 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-611e20b5-9b63-4173-b1c9-ba1f43d286e7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.298740 Jul 25 06:01:45.144728 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-28d9e2bb-9a07-480a-8e04-057f2732ebee tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.391627 Jul 25 06:01:45.145117 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 253/502] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:44 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:45.148184 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 250/503] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:44 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:45.423526 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-1f2efc2e-a8a7-4bc7-ae6f-840e765a8672 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:45.425856 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-1f2efc2e-a8a7-4bc7-ae6f-840e765a8672 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:45.434791 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1f2efc2e-a8a7-4bc7-ae6f-840e765a8672 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:45.436047 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1f2efc2e-a8a7-4bc7-ae6f-840e765a8672 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:45.439633 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1f2efc2e-a8a7-4bc7-ae6f-840e765a8672 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:45.440329 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1f2efc2e-a8a7-4bc7-ae6f-840e765a8672 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:45.481632 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1f2efc2e-a8a7-4bc7-ae6f-840e765a8672 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:45.494936 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1f2efc2e-a8a7-4bc7-ae6f-840e765a8672 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:45.495507 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.objects.instance [None req-1f2efc2e-a8a7-4bc7-ae6f-840e765a8672 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lazy-loading 'fault' on Instance uuid 7e42471b-2518-4844-b7de-4e14e425fe2c {{(pid=130163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:01:45.575302 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-5bdd5e48-fa8d-4b5d-bced-dca8e66e9024 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:45.577354 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-5bdd5e48-fa8d-4b5d-bced-dca8e66e9024 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:45.606083 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5bdd5e48-fa8d-4b5d-bced-dca8e66e9024 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:45.606933 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5bdd5e48-fa8d-4b5d-bced-dca8e66e9024 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:45.608278 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5bdd5e48-fa8d-4b5d-bced-dca8e66e9024 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:45.609123 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5bdd5e48-fa8d-4b5d-bced-dca8e66e9024 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:45.665672 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-1f2efc2e-a8a7-4bc7-ae6f-840e765a8672 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:45.675442 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=4 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:45.679460 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-1f2efc2e-a8a7-4bc7-ae6f-840e765a8672 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1309 microversion: 2.1 time: 0.257154 Jul 25 06:01:45.680768 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 254/504] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:45 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1309 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:45.877346 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5bdd5e48-fa8d-4b5d-bced-dca8e66e9024 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:45.885774 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-5bdd5e48-fa8d-4b5d-bced-dca8e66e9024 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1372 microversion: 2.1 time: 0.315797 Jul 25 06:01:45.887013 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 251/505] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:45 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1372 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:46.034547 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-96a248bf-2c31-4e1e-a623-e913ae979363 req-0d6ea449-d71c-41e8-8561-bbcf676370c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1007f9b0-08e2-4d72-91e9-586792d0695b", "tag": "3dfa9b78-4afb-4b3a-b13e-7a68f5d8ecc8"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:46.044298 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-96a248bf-2c31-4e1e-a623-e913ae979363 req-0d6ea449-d71c-41e8-8561-bbcf676370c2 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:46.045100 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-96a248bf-2c31-4e1e-a623-e913ae979363 req-0d6ea449-d71c-41e8-8561-bbcf676370c2 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:46.062859 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-96a248bf-2c31-4e1e-a623-e913ae979363 req-0d6ea449-d71c-41e8-8561-bbcf676370c2 service nova] Creating event network-changed:3dfa9b78-4afb-4b3a-b13e-7a68f5d8ecc8 for instance 1007f9b0-08e2-4d72-91e9-586792d0695b on hv-cinder-85083 Jul 25 06:01:46.068789 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-96a248bf-2c31-4e1e-a623-e913ae979363 req-0d6ea449-d71c-41e8-8561-bbcf676370c2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041041 Jul 25 06:01:46.069912 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 255/506] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:46.169784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b93de0c2-9528-4c86-9b9e-5ebcbf2452d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:46.170283 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f2fc18fb-3d36-495c-a191-5eb3c867e403 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:46.170961 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f2fc18fb-3d36-495c-a191-5eb3c867e403 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:46.172323 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b93de0c2-9528-4c86-9b9e-5ebcbf2452d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:46.180268 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b93de0c2-9528-4c86-9b9e-5ebcbf2452d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:46.180725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b93de0c2-9528-4c86-9b9e-5ebcbf2452d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:46.181689 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b93de0c2-9528-4c86-9b9e-5ebcbf2452d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:46.182415 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b93de0c2-9528-4c86-9b9e-5ebcbf2452d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:46.182609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f2fc18fb-3d36-495c-a191-5eb3c867e403 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:46.183250 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f2fc18fb-3d36-495c-a191-5eb3c867e403 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:46.187710 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f2fc18fb-3d36-495c-a191-5eb3c867e403 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:46.187710 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f2fc18fb-3d36-495c-a191-5eb3c867e403 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:46.362660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-f2fc18fb-3d36-495c-a191-5eb3c867e403 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:46.368229 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b93de0c2-9528-4c86-9b9e-5ebcbf2452d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:46.376383 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f2fc18fb-3d36-495c-a191-5eb3c867e403 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.215311 Jul 25 06:01:46.380546 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b93de0c2-9528-4c86-9b9e-5ebcbf2452d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:46.383489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b93de0c2-9528-4c86-9b9e-5ebcbf2452d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:46.385884 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b93de0c2-9528-4c86-9b9e-5ebcbf2452d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.222283 Jul 25 06:01:46.388657 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 252/507] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:46 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:46.400641 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 256/508] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:46 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:46.719052 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3aaafe24-6418-4f51-86f5-cea33cce4b6a tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:46.719052 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3aaafe24-6418-4f51-86f5-cea33cce4b6a tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:46.719052 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3aaafe24-6418-4f51-86f5-cea33cce4b6a tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:46.719052 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3aaafe24-6418-4f51-86f5-cea33cce4b6a tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:46.719404 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3aaafe24-6418-4f51-86f5-cea33cce4b6a tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:46.719404 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3aaafe24-6418-4f51-86f5-cea33cce4b6a tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:46.763440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3aaafe24-6418-4f51-86f5-cea33cce4b6a tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:46.763440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3aaafe24-6418-4f51-86f5-cea33cce4b6a tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:46.763440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-3aaafe24-6418-4f51-86f5-cea33cce4b6a tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lazy-loading 'fault' on Instance uuid 7e42471b-2518-4844-b7de-4e14e425fe2c {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:01:46.804044 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3aaafe24-6418-4f51-86f5-cea33cce4b6a tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:46.812151 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3aaafe24-6418-4f51-86f5-cea33cce4b6a tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 200 len: 1309 microversion: 2.1 time: 0.111808 Jul 25 06:01:46.819079 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 253/509] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:46 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 1309 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:46.903975 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-69ada898-33e8-44be-a49b-fc91d7f4433a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:46.905425 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-69ada898-33e8-44be-a49b-fc91d7f4433a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:46.915416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-69ada898-33e8-44be-a49b-fc91d7f4433a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:46.917890 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-69ada898-33e8-44be-a49b-fc91d7f4433a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:46.918894 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-69ada898-33e8-44be-a49b-fc91d7f4433a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:46.919557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-69ada898-33e8-44be-a49b-fc91d7f4433a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:47.094123 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-69ada898-33e8-44be-a49b-fc91d7f4433a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:47.103908 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-69ada898-33e8-44be-a49b-fc91d7f4433a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1567 microversion: 2.1 time: 0.204546 Jul 25 06:01:47.115720 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 257/510] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:46 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:47.122338 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-712b3644-8c6c-45fb-9aa7-aa5dcb8134d8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:47.122860 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-712b3644-8c6c-45fb-9aa7-aa5dcb8134d8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:47.130931 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-712b3644-8c6c-45fb-9aa7-aa5dcb8134d8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:47.131708 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-712b3644-8c6c-45fb-9aa7-aa5dcb8134d8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:47.132739 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-712b3644-8c6c-45fb-9aa7-aa5dcb8134d8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:47.133424 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-712b3644-8c6c-45fb-9aa7-aa5dcb8134d8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:47.227332 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-712b3644-8c6c-45fb-9aa7-aa5dcb8134d8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109261 Jul 25 06:01:47.228349 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 254/511] 10.222.0.17 () {58 vars in 1274 bytes} [Mon Jul 25 06:01:47 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:47.407743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1510dd81-f15a-40ff-9e4a-276e34a13cea tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:47.408076 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a45601a3-692b-45e8-87cc-b8e925069a28 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:47.408360 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1510dd81-f15a-40ff-9e4a-276e34a13cea tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:47.408744 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a45601a3-692b-45e8-87cc-b8e925069a28 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:47.414067 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:47.417998 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a45601a3-692b-45e8-87cc-b8e925069a28 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:47.419234 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a45601a3-692b-45e8-87cc-b8e925069a28 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:47.421202 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a45601a3-692b-45e8-87cc-b8e925069a28 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:47.421671 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a45601a3-692b-45e8-87cc-b8e925069a28 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:47.422512 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1510dd81-f15a-40ff-9e4a-276e34a13cea tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:47.422956 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1510dd81-f15a-40ff-9e4a-276e34a13cea tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:47.423729 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1510dd81-f15a-40ff-9e4a-276e34a13cea tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:47.424169 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1510dd81-f15a-40ff-9e4a-276e34a13cea tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:47.685813 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a45601a3-692b-45e8-87cc-b8e925069a28 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:47.696844 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a45601a3-692b-45e8-87cc-b8e925069a28 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.293094 Jul 25 06:01:47.707593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 258/512] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:47 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:47.802906 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1510dd81-f15a-40ff-9e4a-276e34a13cea tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:47.819318 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1510dd81-f15a-40ff-9e4a-276e34a13cea tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:47.822317 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1510dd81-f15a-40ff-9e4a-276e34a13cea tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:47.823942 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1510dd81-f15a-40ff-9e4a-276e34a13cea tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.420247 Jul 25 06:01:47.824727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 255/513] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:47 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:47.843959 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a8ff309d-8734-4559-9726-77f20dc8d135 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:47.847195 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a8ff309d-8734-4559-9726-77f20dc8d135 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 7e42471b-2518-4844-b7de-4e14e425fe2c] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:47.857695 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a8ff309d-8734-4559-9726-77f20dc8d135 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:47.858943 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a8ff309d-8734-4559-9726-77f20dc8d135 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:47.860254 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a8ff309d-8734-4559-9726-77f20dc8d135 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:47.860971 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a8ff309d-8734-4559-9726-77f20dc8d135 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:47.885067 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-a8ff309d-8734-4559-9726-77f20dc8d135 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] HTTP exception thrown: Instance 7e42471b-2518-4844-b7de-4e14e425fe2c could not be found. Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a8ff309d-8734-4559-9726-77f20dc8d135 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Request method failure captured: Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c HTTP/1.1 Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jF3XTd91ynaBAE-diOQaHdyc6_zgnArxLWfPPC4iYU2ZZRgBzDaHUASA6SKJPrp0DE-Yqbd6JF81anhoY8c5hk_6D8Zap4wEtujNfCzomkW3KVFcIplO23oxNNVoDZNGrlOxkBB07s8J8EuISzRFn5yriyWwLBvBB2gKN_4wXBUQVY Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: d9f37a52ba6146e5b1cccfdba0c60a18 Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1922150703 Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:01:47.887513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:01:47.889009 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9f37a52ba6146e5b1cccfdba0c60a18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9f37a52ba6146e5b1cccfdba0c60a18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d9f37a52ba6146e5b1cccfdba0c60a18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d9f37a52ba6146e5b1cccfdba0c60a18", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:01:47.889009 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-VolumesSnapshotTestJSON-1922150703 Jul 25 06:01:47.889009 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: d9f37a52ba6146e5b1cccfdba0c60a18 Jul 25 06:01:47.889009 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1922150703 Jul 25 06:01:47.889009 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-VolumesSnapshotTestJSON-1922150703-project Jul 25 06:01:47.889009 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:01:47.889009 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:01:47.889009 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 99feeb6cf0fa46b4aabecefcdf56deff Jul 25 06:01:47.889009 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-VolumesSnapshotTestJSON-1922150703-project Jul 25 06:01:47.889009 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:01:47.889009 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 7e42471b-2518-4844-b7de-4e14e425fe2c could not be found. Jul 25 06:01:47.889009 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '7e42471b-2518-4844-b7de-4e14e425fe2c'} Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e42471b-2518-4844-b7de-4e14e425fe2c could not be found. Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:01:47.889784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e42471b-2518-4844-b7de-4e14e425fe2c could not be found. Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e42471b-2518-4844-b7de-4e14e425fe2c could not be found. Jul 25 06:01:47.892296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:01:47.895121 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a8ff309d-8734-4559-9726-77f20dc8d135 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Returning 404 to user: Instance 7e42471b-2518-4844-b7de-4e14e425fe2c could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:01:47.896344 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a8ff309d-8734-4559-9726-77f20dc8d135 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c" status: 404 len: 111 microversion: 2.1 time: 0.058820 Jul 25 06:01:47.912490 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 259/514] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:47 2022] GET /compute/v2.1/servers/7e42471b-2518-4844-b7de-4e14e425fe2c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:01:48.722710 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-bc1a82a2-d514-4e32-aaa5-236fc1f1c071 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:48.723444 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-bc1a82a2-d514-4e32-aaa5-236fc1f1c071 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:48.735704 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bc1a82a2-d514-4e32-aaa5-236fc1f1c071 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:48.736949 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bc1a82a2-d514-4e32-aaa5-236fc1f1c071 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:48.737640 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bc1a82a2-d514-4e32-aaa5-236fc1f1c071 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:48.740084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bc1a82a2-d514-4e32-aaa5-236fc1f1c071 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:48.844658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-55b4f1b6-3c10-42a6-86c5-17f4968fbdbd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:48.845561 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-55b4f1b6-3c10-42a6-86c5-17f4968fbdbd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:48.860876 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-55b4f1b6-3c10-42a6-86c5-17f4968fbdbd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:48.870172 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-55b4f1b6-3c10-42a6-86c5-17f4968fbdbd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:48.871309 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-55b4f1b6-3c10-42a6-86c5-17f4968fbdbd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:48.871934 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-55b4f1b6-3c10-42a6-86c5-17f4968fbdbd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:49.135675 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-55b4f1b6-3c10-42a6-86c5-17f4968fbdbd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:49.147110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-55b4f1b6-3c10-42a6-86c5-17f4968fbdbd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:49.148048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-55b4f1b6-3c10-42a6-86c5-17f4968fbdbd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:49.157858 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-55b4f1b6-3c10-42a6-86c5-17f4968fbdbd tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.308558 Jul 25 06:01:49.160780 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 260/515] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:48 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:01:49.256044 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-bc1a82a2-d514-4e32-aaa5-236fc1f1c071 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:49.265670 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-bc1a82a2-d514-4e32-aaa5-236fc1f1c071 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.546064 Jul 25 06:01:49.266726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 256/516] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:48 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:49.392447 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-3c5f9f54-ab44-4fd5-9ecf-3b6b8f716cf2 req-fe34d7f5-40ee-4a8b-9eda-56cd47a85afa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7bc67af-311c-4441-bd3e-96e8387de26e", "tag": "a31d1086-8cc8-4cdd-8ab6-2db983070eae"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:49.402842 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-3c5f9f54-ab44-4fd5-9ecf-3b6b8f716cf2 req-fe34d7f5-40ee-4a8b-9eda-56cd47a85afa service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:49.403506 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-3c5f9f54-ab44-4fd5-9ecf-3b6b8f716cf2 req-fe34d7f5-40ee-4a8b-9eda-56cd47a85afa service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:49.421422 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-3c5f9f54-ab44-4fd5-9ecf-3b6b8f716cf2 req-fe34d7f5-40ee-4a8b-9eda-56cd47a85afa service nova] Creating event network-changed:a31d1086-8cc8-4cdd-8ab6-2db983070eae for instance d7bc67af-311c-4441-bd3e-96e8387de26e on hv-cinder-85083 Jul 25 06:01:49.430583 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-3c5f9f54-ab44-4fd5-9ecf-3b6b8f716cf2 req-fe34d7f5-40ee-4a8b-9eda-56cd47a85afa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039792 Jul 25 06:01:49.435486 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 261/517] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:50.179395 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f8dcf7b0-83fa-4801-9e2e-a6ad820f0485 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:50.182683 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f8dcf7b0-83fa-4801-9e2e-a6ad820f0485 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:50.192831 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f8dcf7b0-83fa-4801-9e2e-a6ad820f0485 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:50.193411 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f8dcf7b0-83fa-4801-9e2e-a6ad820f0485 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:50.194247 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f8dcf7b0-83fa-4801-9e2e-a6ad820f0485 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:50.194715 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f8dcf7b0-83fa-4801-9e2e-a6ad820f0485 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:50.288609 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d8c397fe-835d-40fb-9bac-3703df8ab28b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:50.291053 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d8c397fe-835d-40fb-9bac-3703df8ab28b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:50.308058 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d8c397fe-835d-40fb-9bac-3703df8ab28b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:50.310388 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d8c397fe-835d-40fb-9bac-3703df8ab28b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:50.315540 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d8c397fe-835d-40fb-9bac-3703df8ab28b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:50.316567 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d8c397fe-835d-40fb-9bac-3703df8ab28b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:50.548766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d8c397fe-835d-40fb-9bac-3703df8ab28b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:50.564118 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d8c397fe-835d-40fb-9bac-3703df8ab28b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.284530 Jul 25 06:01:50.574857 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 262/518] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:50 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:50.786244 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-f8dcf7b0-83fa-4801-9e2e-a6ad820f0485 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:50.808036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-f8dcf7b0-83fa-4801-9e2e-a6ad820f0485 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:50.810136 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-f8dcf7b0-83fa-4801-9e2e-a6ad820f0485 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:50.811563 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f8dcf7b0-83fa-4801-9e2e-a6ad820f0485 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.636208 Jul 25 06:01:50.812303 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 257/519] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:50 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:51.581657 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-77292a37-04eb-4e33-936c-982399a982ee tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:51.582237 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-77292a37-04eb-4e33-936c-982399a982ee tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:51.589757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-77292a37-04eb-4e33-936c-982399a982ee tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:51.590289 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-77292a37-04eb-4e33-936c-982399a982ee tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:51.591094 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-77292a37-04eb-4e33-936c-982399a982ee tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:51.591530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-77292a37-04eb-4e33-936c-982399a982ee tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:51.733227 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-77292a37-04eb-4e33-936c-982399a982ee tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:51.742568 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-77292a37-04eb-4e33-936c-982399a982ee tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.164203 Jul 25 06:01:51.750294 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 263/520] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:51 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:51.830201 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3aec1b6b-c6c3-4071-806f-5191c42f8d28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:51.831802 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3aec1b6b-c6c3-4071-806f-5191c42f8d28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:51.838398 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3aec1b6b-c6c3-4071-806f-5191c42f8d28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:51.838881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3aec1b6b-c6c3-4071-806f-5191c42f8d28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:51.839657 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3aec1b6b-c6c3-4071-806f-5191c42f8d28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:51.840098 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3aec1b6b-c6c3-4071-806f-5191c42f8d28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:51.975865 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3aec1b6b-c6c3-4071-806f-5191c42f8d28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:51.984898 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3aec1b6b-c6c3-4071-806f-5191c42f8d28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:51.986394 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3aec1b6b-c6c3-4071-806f-5191c42f8d28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:51.987580 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3aec1b6b-c6c3-4071-806f-5191c42f8d28 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.161673 Jul 25 06:01:51.988140 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 258/521] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:51 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:52.761107 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-36eb1522-9bb2-470a-bdf1-a81beebe68c5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:52.761779 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-36eb1522-9bb2-470a-bdf1-a81beebe68c5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:52.769099 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-36eb1522-9bb2-470a-bdf1-a81beebe68c5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:52.769863 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-36eb1522-9bb2-470a-bdf1-a81beebe68c5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:52.770678 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-36eb1522-9bb2-470a-bdf1-a81beebe68c5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:52.771300 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-36eb1522-9bb2-470a-bdf1-a81beebe68c5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:52.780305 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=100 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:52.966764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-36eb1522-9bb2-470a-bdf1-a81beebe68c5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:52.974894 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-36eb1522-9bb2-470a-bdf1-a81beebe68c5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.218284 Jul 25 06:01:52.984625 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 264/522] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:52 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:53.008445 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-bfe4e5ba-b1c5-4fa7-82d7-0b855981331b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:53.009263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-bfe4e5ba-b1c5-4fa7-82d7-0b855981331b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:53.019847 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bfe4e5ba-b1c5-4fa7-82d7-0b855981331b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:53.020583 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bfe4e5ba-b1c5-4fa7-82d7-0b855981331b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:53.021440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bfe4e5ba-b1c5-4fa7-82d7-0b855981331b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:53.021949 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bfe4e5ba-b1c5-4fa7-82d7-0b855981331b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:53.254268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-bfe4e5ba-b1c5-4fa7-82d7-0b855981331b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:53.268233 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-bfe4e5ba-b1c5-4fa7-82d7-0b855981331b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:53.272037 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-bfe4e5ba-b1c5-4fa7-82d7-0b855981331b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:53.273660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-bfe4e5ba-b1c5-4fa7-82d7-0b855981331b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.270671 Jul 25 06:01:53.274461 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 259/523] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:53 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:53.993222 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d3b09f13-66a7-422f-acfc-4c8bc58a03de tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:53.994022 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d3b09f13-66a7-422f-acfc-4c8bc58a03de tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:54.000585 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d3b09f13-66a7-422f-acfc-4c8bc58a03de tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:54.001138 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d3b09f13-66a7-422f-acfc-4c8bc58a03de tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:54.002135 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d3b09f13-66a7-422f-acfc-4c8bc58a03de tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:54.002693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d3b09f13-66a7-422f-acfc-4c8bc58a03de tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:54.245699 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d3b09f13-66a7-422f-acfc-4c8bc58a03de tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:54.253298 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d3b09f13-66a7-422f-acfc-4c8bc58a03de tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.265142 Jul 25 06:01:54.253863 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 265/524] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:53 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:54.293636 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2b83fb96-205a-4cca-a536-cb2c0919f0d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:54.294254 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2b83fb96-205a-4cca-a536-cb2c0919f0d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:54.301058 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2b83fb96-205a-4cca-a536-cb2c0919f0d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:54.301516 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2b83fb96-205a-4cca-a536-cb2c0919f0d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:54.302372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2b83fb96-205a-4cca-a536-cb2c0919f0d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:54.302838 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2b83fb96-205a-4cca-a536-cb2c0919f0d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:54.437556 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2b83fb96-205a-4cca-a536-cb2c0919f0d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:54.447385 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2b83fb96-205a-4cca-a536-cb2c0919f0d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:54.449747 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2b83fb96-205a-4cca-a536-cb2c0919f0d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:54.451434 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2b83fb96-205a-4cca-a536-cb2c0919f0d6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.162479 Jul 25 06:01:54.460562 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 260/525] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:54 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:55.269946 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ae40abb6-f600-4f74-8347-704cd9e31cf3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:55.271763 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ae40abb6-f600-4f74-8347-704cd9e31cf3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:55.279619 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ae40abb6-f600-4f74-8347-704cd9e31cf3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:55.280416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ae40abb6-f600-4f74-8347-704cd9e31cf3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:55.281367 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ae40abb6-f600-4f74-8347-704cd9e31cf3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:55.281960 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ae40abb6-f600-4f74-8347-704cd9e31cf3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:55.450395 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ae40abb6-f600-4f74-8347-704cd9e31cf3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:55.458801 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ae40abb6-f600-4f74-8347-704cd9e31cf3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.193087 Jul 25 06:01:55.459843 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 266/526] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:55 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:55.469301 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-92a0c7b1-a173-494e-9b3c-c0556ce27b80 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:55.470695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-92a0c7b1-a173-494e-9b3c-c0556ce27b80 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:55.479589 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-92a0c7b1-a173-494e-9b3c-c0556ce27b80 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:55.480034 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-92a0c7b1-a173-494e-9b3c-c0556ce27b80 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:55.480829 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-92a0c7b1-a173-494e-9b3c-c0556ce27b80 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:55.481255 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-92a0c7b1-a173-494e-9b3c-c0556ce27b80 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:55.624202 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-92a0c7b1-a173-494e-9b3c-c0556ce27b80 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:55.633752 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-92a0c7b1-a173-494e-9b3c-c0556ce27b80 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:55.635368 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-92a0c7b1-a173-494e-9b3c-c0556ce27b80 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:55.636628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-92a0c7b1-a173-494e-9b3c-c0556ce27b80 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.171280 Jul 25 06:01:55.637249 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 261/527] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:55 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:01:56.479205 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-80289590-e04c-4af4-8929-56e3e93a56b4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:56.483805 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-80289590-e04c-4af4-8929-56e3e93a56b4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:56.503986 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-80289590-e04c-4af4-8929-56e3e93a56b4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:56.504577 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-80289590-e04c-4af4-8929-56e3e93a56b4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:56.505429 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-80289590-e04c-4af4-8929-56e3e93a56b4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:56.505877 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-80289590-e04c-4af4-8929-56e3e93a56b4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:56.655331 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-4825ad21-1096-4d77-be55-c5e459dd3a86 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:56.656054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-4825ad21-1096-4d77-be55-c5e459dd3a86 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:56.664191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4825ad21-1096-4d77-be55-c5e459dd3a86 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:56.675705 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4825ad21-1096-4d77-be55-c5e459dd3a86 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:56.675705 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4825ad21-1096-4d77-be55-c5e459dd3a86 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:56.675705 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4825ad21-1096-4d77-be55-c5e459dd3a86 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:56.711911 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-80289590-e04c-4af4-8929-56e3e93a56b4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:56.720239 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-80289590-e04c-4af4-8929-56e3e93a56b4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.246056 Jul 25 06:01:56.721430 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 267/528] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:56 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:56.869052 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4825ad21-1096-4d77-be55-c5e459dd3a86 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:56.878879 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4825ad21-1096-4d77-be55-c5e459dd3a86 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:56.889667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4825ad21-1096-4d77-be55-c5e459dd3a86 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:56.890915 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-4825ad21-1096-4d77-be55-c5e459dd3a86 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.239999 Jul 25 06:01:56.891914 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 262/529] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:56 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:01:57.738782 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-63081260-6574-4a48-92de-902a37cd60cc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:57.740173 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-63081260-6574-4a48-92de-902a37cd60cc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:57.761820 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63081260-6574-4a48-92de-902a37cd60cc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:57.762797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63081260-6574-4a48-92de-902a37cd60cc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:57.767498 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63081260-6574-4a48-92de-902a37cd60cc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:57.768163 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63081260-6574-4a48-92de-902a37cd60cc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:57.915343 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-28cd1dc8-8857-4e63-9178-a935c6b3f3c9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:57.916033 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-28cd1dc8-8857-4e63-9178-a935c6b3f3c9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:57.935859 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28cd1dc8-8857-4e63-9178-a935c6b3f3c9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:57.936680 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28cd1dc8-8857-4e63-9178-a935c6b3f3c9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:57.937814 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28cd1dc8-8857-4e63-9178-a935c6b3f3c9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:57.938398 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28cd1dc8-8857-4e63-9178-a935c6b3f3c9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:58.055324 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-63081260-6574-4a48-92de-902a37cd60cc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:58.065195 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-63081260-6574-4a48-92de-902a37cd60cc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.331503 Jul 25 06:01:58.071163 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 268/530] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:57 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:58.237474 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-28cd1dc8-8857-4e63-9178-a935c6b3f3c9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:58.262855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-28cd1dc8-8857-4e63-9178-a935c6b3f3c9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:58.262855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-28cd1dc8-8857-4e63-9178-a935c6b3f3c9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:58.262855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-28cd1dc8-8857-4e63-9178-a935c6b3f3c9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.349885 Jul 25 06:01:58.275584 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 263/531] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:57 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:01:59.083282 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-520df430-8a58-407c-a144-de0c733d7a58 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:59.084161 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-520df430-8a58-407c-a144-de0c733d7a58 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:59.091593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-520df430-8a58-407c-a144-de0c733d7a58 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:59.094901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-520df430-8a58-407c-a144-de0c733d7a58 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:59.094901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-520df430-8a58-407c-a144-de0c733d7a58 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:59.094901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-520df430-8a58-407c-a144-de0c733d7a58 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:59.284474 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8467ba72-7ea3-41e4-9f63-3a9ab16dd556 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:59.285146 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8467ba72-7ea3-41e4-9f63-3a9ab16dd556 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:59.295804 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8467ba72-7ea3-41e4-9f63-3a9ab16dd556 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:59.296475 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8467ba72-7ea3-41e4-9f63-3a9ab16dd556 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:59.297366 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8467ba72-7ea3-41e4-9f63-3a9ab16dd556 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:59.297469 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-520df430-8a58-407c-a144-de0c733d7a58 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:59.298007 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8467ba72-7ea3-41e4-9f63-3a9ab16dd556 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:59.308099 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-520df430-8a58-407c-a144-de0c733d7a58 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.229032 Jul 25 06:01:59.310542 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 269/532] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:59 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:59.469887 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8467ba72-7ea3-41e4-9f63-3a9ab16dd556 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:59.480033 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8467ba72-7ea3-41e4-9f63-3a9ab16dd556 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:59.481532 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8467ba72-7ea3-41e4-9f63-3a9ab16dd556 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:59.482728 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-8467ba72-7ea3-41e4-9f63-3a9ab16dd556 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.202379 Jul 25 06:01:59.483286 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 264/533] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:59 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:00.325141 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-35d09b60-1b67-4eec-8c7c-6c4bdf736742 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:00.326278 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-35d09b60-1b67-4eec-8c7c-6c4bdf736742 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:00.332166 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-35d09b60-1b67-4eec-8c7c-6c4bdf736742 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:00.332614 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-35d09b60-1b67-4eec-8c7c-6c4bdf736742 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:00.333386 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-35d09b60-1b67-4eec-8c7c-6c4bdf736742 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:00.333802 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-35d09b60-1b67-4eec-8c7c-6c4bdf736742 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:00.461407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-35d09b60-1b67-4eec-8c7c-6c4bdf736742 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:00.468728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-35d09b60-1b67-4eec-8c7c-6c4bdf736742 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.147444 Jul 25 06:02:00.469290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 270/534] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:00 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:00.500482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-5a0ab515-6141-4db6-bacb-3fb9d9e25ed0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:00.501088 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-5a0ab515-6141-4db6-bacb-3fb9d9e25ed0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:00.507977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5a0ab515-6141-4db6-bacb-3fb9d9e25ed0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:00.508417 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5a0ab515-6141-4db6-bacb-3fb9d9e25ed0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:00.509156 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5a0ab515-6141-4db6-bacb-3fb9d9e25ed0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:00.509582 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5a0ab515-6141-4db6-bacb-3fb9d9e25ed0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:00.635638 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5a0ab515-6141-4db6-bacb-3fb9d9e25ed0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:00.643855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5a0ab515-6141-4db6-bacb-3fb9d9e25ed0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:00.645352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5a0ab515-6141-4db6-bacb-3fb9d9e25ed0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:00.646510 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-5a0ab515-6141-4db6-bacb-3fb9d9e25ed0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.149831 Jul 25 06:02:00.648454 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 265/535] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:00 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:01.485140 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ee9575b6-daae-4420-93e5-ef452e695faf tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:01.486398 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ee9575b6-daae-4420-93e5-ef452e695faf tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:01.493364 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ee9575b6-daae-4420-93e5-ef452e695faf tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:01.494145 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ee9575b6-daae-4420-93e5-ef452e695faf tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:01.495200 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ee9575b6-daae-4420-93e5-ef452e695faf tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:01.495850 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ee9575b6-daae-4420-93e5-ef452e695faf tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:01.667253 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-20800c85-bff9-4e87-91fe-434ab6e89e17 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:01.668265 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-20800c85-bff9-4e87-91fe-434ab6e89e17 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:01.678560 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-20800c85-bff9-4e87-91fe-434ab6e89e17 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:01.679468 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-20800c85-bff9-4e87-91fe-434ab6e89e17 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:01.680347 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-20800c85-bff9-4e87-91fe-434ab6e89e17 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:01.680862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-20800c85-bff9-4e87-91fe-434ab6e89e17 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:01.754289 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ee9575b6-daae-4420-93e5-ef452e695faf tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:01.770703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ee9575b6-daae-4420-93e5-ef452e695faf tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.289081 Jul 25 06:02:01.775044 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 271/536] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:01 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:01.925889 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-20800c85-bff9-4e87-91fe-434ab6e89e17 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:01.953112 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-20800c85-bff9-4e87-91fe-434ab6e89e17 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:01.954639 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-20800c85-bff9-4e87-91fe-434ab6e89e17 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:01.955866 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-20800c85-bff9-4e87-91fe-434ab6e89e17 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.293641 Jul 25 06:02:01.957176 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 266/537] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:01 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:02.047054 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-53d4c508-b8bf-4014-b8c0-97f9803fd5f6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1163940450", "imageRef": "bfffd6ef-7f99-4a99-90f3-027fe9c89821", "flavorRef": "452", "networks": [{"uuid": "52152d6b-07f7-45ec-8d46-9e0aae61f6a5"}]}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:02.382794 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.network.neutron [None req-53d4c508-b8bf-4014-b8c0-97f9803fd5f6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] validate_networks() for [('52152d6b-07f7-45ec-8d46-9e0aae61f6a5', None, None, None, None, None)] {{(pid=130163) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:02:02.788513 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-fd3c01d6-95e8-4984-89b2-a664812e2636 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:02.790112 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-fd3c01d6-95e8-4984-89b2-a664812e2636 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:02.797546 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fd3c01d6-95e8-4984-89b2-a664812e2636 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:02.798110 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fd3c01d6-95e8-4984-89b2-a664812e2636 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:02.799027 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fd3c01d6-95e8-4984-89b2-a664812e2636 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:02.799974 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fd3c01d6-95e8-4984-89b2-a664812e2636 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:02.804880 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=100 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:02.884990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-53d4c508-b8bf-4014-b8c0-97f9803fd5f6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Flavor limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:02:02.885503 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-53d4c508-b8bf-4014-b8c0-97f9803fd5f6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Image limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:02:02.885883 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-53d4c508-b8bf-4014-b8c0-97f9803fd5f6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Flavor pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:02:02.886296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-53d4c508-b8bf-4014-b8c0-97f9803fd5f6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Image pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:02:02.886736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-53d4c508-b8bf-4014-b8c0-97f9803fd5f6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:02:02.910996 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-53d4c508-b8bf-4014-b8c0-97f9803fd5f6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:02.911264 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-53d4c508-b8bf-4014-b8c0-97f9803fd5f6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:02.912082 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-53d4c508-b8bf-4014-b8c0-97f9803fd5f6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:02.912699 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-53d4c508-b8bf-4014-b8c0-97f9803fd5f6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:02.934564 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-53d4c508-b8bf-4014-b8c0-97f9803fd5f6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Getting quotas for project d9f37a52ba6146e5b1cccfdba0c60a18. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:02:02.940006 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-53d4c508-b8bf-4014-b8c0-97f9803fd5f6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Getting quotas for user 99feeb6cf0fa46b4aabecefcdf56deff and project d9f37a52ba6146e5b1cccfdba0c60a18. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:02:02.953800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-53d4c508-b8bf-4014-b8c0-97f9803fd5f6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Going to run 1 instances... {{(pid=130163) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:02:02.956587 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-53d4c508-b8bf-4014-b8c0-97f9803fd5f6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfffd6ef-7f99-4a99-90f3-027fe9c89821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:02:02.963274 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-fd3c01d6-95e8-4984-89b2-a664812e2636 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:02.974234 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-fd3c01d6-95e8-4984-89b2-a664812e2636 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.190148 Jul 25 06:02:02.974949 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 267/538] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:02 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:02.988926 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-04ba4465-81d4-4d87-b8cb-7054497eea4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:02.989732 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-04ba4465-81d4-4d87-b8cb-7054497eea4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:02.996964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-04ba4465-81d4-4d87-b8cb-7054497eea4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:02.997428 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-04ba4465-81d4-4d87-b8cb-7054497eea4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:02.998205 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-04ba4465-81d4-4d87-b8cb-7054497eea4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:02.998667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-04ba4465-81d4-4d87-b8cb-7054497eea4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:03.064434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-53d4c508-b8bf-4014-b8c0-97f9803fd5f6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.020703 Jul 25 06:02:03.065561 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 272/539] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 06:02:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:02:03.077425 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-580e245b-c11a-40c9-9801-5e4812a31169 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:03.078369 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-580e245b-c11a-40c9-9801-5e4812a31169 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:03.172180 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-580e245b-c11a-40c9-9801-5e4812a31169 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:03.187696 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-580e245b-c11a-40c9-9801-5e4812a31169 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1219 microversion: 2.1 time: 0.114953 Jul 25 06:02:03.198267 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 273/540] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:03 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:03.218633 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-04ba4465-81d4-4d87-b8cb-7054497eea4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:03.233550 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-04ba4465-81d4-4d87-b8cb-7054497eea4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:03.236584 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-04ba4465-81d4-4d87-b8cb-7054497eea4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:03.243164 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-04ba4465-81d4-4d87-b8cb-7054497eea4e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.257919 Jul 25 06:02:03.247840 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 268/541] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:02 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:03.991992 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7a0fb7ed-bc0a-4ebb-a484-fa34bbd99492 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:03.994281 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7a0fb7ed-bc0a-4ebb-a484-fa34bbd99492 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:04.002381 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7a0fb7ed-bc0a-4ebb-a484-fa34bbd99492 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:04.003135 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7a0fb7ed-bc0a-4ebb-a484-fa34bbd99492 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:04.004328 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7a0fb7ed-bc0a-4ebb-a484-fa34bbd99492 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:04.004997 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7a0fb7ed-bc0a-4ebb-a484-fa34bbd99492 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:04.201782 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7a0fb7ed-bc0a-4ebb-a484-fa34bbd99492 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:04.205223 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-dc07aa71-f147-4506-b786-43dc033215ee tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:04.206045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-dc07aa71-f147-4506-b786-43dc033215ee tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:04.212980 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-7a0fb7ed-bc0a-4ebb-a484-fa34bbd99492 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.225357 Jul 25 06:02:04.213992 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 274/542] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:03 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:04.214944 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dc07aa71-f147-4506-b786-43dc033215ee tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:04.215403 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dc07aa71-f147-4506-b786-43dc033215ee tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:04.220268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dc07aa71-f147-4506-b786-43dc033215ee tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:04.220732 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dc07aa71-f147-4506-b786-43dc033215ee tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:04.266459 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a749dda6-5be9-4641-96bc-4c885d9f573f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:04.267103 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a749dda6-5be9-4641-96bc-4c885d9f573f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:04.274191 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a749dda6-5be9-4641-96bc-4c885d9f573f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:04.274677 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a749dda6-5be9-4641-96bc-4c885d9f573f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:04.275464 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a749dda6-5be9-4641-96bc-4c885d9f573f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:04.275902 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a749dda6-5be9-4641-96bc-4c885d9f573f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:04.360487 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-dc07aa71-f147-4506-b786-43dc033215ee tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:04.373866 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-dc07aa71-f147-4506-b786-43dc033215ee tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1223 microversion: 2.1 time: 0.172357 Jul 25 06:02:04.374466 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 269/543] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:04 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1223 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:04.452998 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a749dda6-5be9-4641-96bc-4c885d9f573f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:04.464430 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a749dda6-5be9-4641-96bc-4c885d9f573f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:04.466299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a749dda6-5be9-4641-96bc-4c885d9f573f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:04.467671 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a749dda6-5be9-4641-96bc-4c885d9f573f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.205210 Jul 25 06:02:04.468709 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 275/544] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:04 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:05.232692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-769be401-fab9-4be9-bb9a-958c32f65be6 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:05.234311 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-769be401-fab9-4be9-bb9a-958c32f65be6 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:05.242650 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-769be401-fab9-4be9-bb9a-958c32f65be6 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:05.243385 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-769be401-fab9-4be9-bb9a-958c32f65be6 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:05.244472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-769be401-fab9-4be9-bb9a-958c32f65be6 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:05.245277 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-769be401-fab9-4be9-bb9a-958c32f65be6 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:05.394740 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-63350c5f-30d9-4fef-8f0a-6ded4b1027fb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:05.395561 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-63350c5f-30d9-4fef-8f0a-6ded4b1027fb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:05.405773 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63350c5f-30d9-4fef-8f0a-6ded4b1027fb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:05.407392 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63350c5f-30d9-4fef-8f0a-6ded4b1027fb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:05.414631 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63350c5f-30d9-4fef-8f0a-6ded4b1027fb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:05.414631 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63350c5f-30d9-4fef-8f0a-6ded4b1027fb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:05.442971 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-769be401-fab9-4be9-bb9a-958c32f65be6 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:05.450459 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-769be401-fab9-4be9-bb9a-958c32f65be6 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.222670 Jul 25 06:02:05.459921 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 270/545] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:05 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:05.486414 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-4969175d-2976-4a85-b0ca-d46366f77959 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:05.487187 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-4969175d-2976-4a85-b0ca-d46366f77959 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:05.495756 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4969175d-2976-4a85-b0ca-d46366f77959 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:05.496190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4969175d-2976-4a85-b0ca-d46366f77959 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:05.497133 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4969175d-2976-4a85-b0ca-d46366f77959 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:05.497734 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4969175d-2976-4a85-b0ca-d46366f77959 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:05.517658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-63350c5f-30d9-4fef-8f0a-6ded4b1027fb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:05.534938 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-63350c5f-30d9-4fef-8f0a-6ded4b1027fb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1271 microversion: 2.1 time: 0.146048 Jul 25 06:02:05.545030 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 276/546] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:05 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:05.808574 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4969175d-2976-4a85-b0ca-d46366f77959 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:05.823830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4969175d-2976-4a85-b0ca-d46366f77959 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:05.825588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4969175d-2976-4a85-b0ca-d46366f77959 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:05.826862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-4969175d-2976-4a85-b0ca-d46366f77959 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.344442 Jul 25 06:02:05.838009 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 271/547] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:05 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:02:06.467269 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e3729267-d19c-4cbc-b582-1cc662a285bc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:06.468566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e3729267-d19c-4cbc-b582-1cc662a285bc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:06.480730 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e3729267-d19c-4cbc-b582-1cc662a285bc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:06.480730 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e3729267-d19c-4cbc-b582-1cc662a285bc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:06.480730 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e3729267-d19c-4cbc-b582-1cc662a285bc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:06.480730 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e3729267-d19c-4cbc-b582-1cc662a285bc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:06.554959 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-eb59aef7-71cc-46be-b4aa-dcd689a012e9 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:06.556221 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-eb59aef7-71cc-46be-b4aa-dcd689a012e9 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:06.564011 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eb59aef7-71cc-46be-b4aa-dcd689a012e9 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:06.564553 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eb59aef7-71cc-46be-b4aa-dcd689a012e9 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:06.565752 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eb59aef7-71cc-46be-b4aa-dcd689a012e9 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:06.566340 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-eb59aef7-71cc-46be-b4aa-dcd689a012e9 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:06.634103 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e3729267-d19c-4cbc-b582-1cc662a285bc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:06.646793 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e3729267-d19c-4cbc-b582-1cc662a285bc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.183833 Jul 25 06:02:06.647400 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 277/548] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:06 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:06.809424 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-eb59aef7-71cc-46be-b4aa-dcd689a012e9 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:06.816791 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-eb59aef7-71cc-46be-b4aa-dcd689a012e9 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.268465 Jul 25 06:02:06.817365 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 272/549] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:06 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:06.845122 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a87b60ea-3a36-4540-a5d7-a64672582fbf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:06.845835 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a87b60ea-3a36-4540-a5d7-a64672582fbf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:06.852382 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a87b60ea-3a36-4540-a5d7-a64672582fbf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:06.852836 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a87b60ea-3a36-4540-a5d7-a64672582fbf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:06.853609 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a87b60ea-3a36-4540-a5d7-a64672582fbf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:06.854042 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a87b60ea-3a36-4540-a5d7-a64672582fbf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:06.995025 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a87b60ea-3a36-4540-a5d7-a64672582fbf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:07.004176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a87b60ea-3a36-4540-a5d7-a64672582fbf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:07.006840 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a87b60ea-3a36-4540-a5d7-a64672582fbf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:07.020012 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a87b60ea-3a36-4540-a5d7-a64672582fbf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.167779 Jul 25 06:02:07.020931 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 278/550] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:06 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:07.538892 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-2623a1be-4d8a-4dae-9f5b-f89a1a7a7250 req-09b41617-9a4b-4671-8163-653dc81628af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404", "tag": "b64f5129-42ac-424a-aa95-8c9a29c2d5dc"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:07.542188 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-2623a1be-4d8a-4dae-9f5b-f89a1a7a7250 req-09b41617-9a4b-4671-8163-653dc81628af service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:07.542678 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-2623a1be-4d8a-4dae-9f5b-f89a1a7a7250 req-09b41617-9a4b-4671-8163-653dc81628af service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:07.557716 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-2623a1be-4d8a-4dae-9f5b-f89a1a7a7250 req-09b41617-9a4b-4671-8163-653dc81628af service nova] Creating event network-changed:b64f5129-42ac-424a-aa95-8c9a29c2d5dc for instance 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 on hv-cinder-85083 Jul 25 06:02:07.563805 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-2623a1be-4d8a-4dae-9f5b-f89a1a7a7250 req-09b41617-9a4b-4671-8163-653dc81628af service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035270 Jul 25 06:02:07.564766 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 273/551] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:07.664029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-1c94096b-8cae-41a1-85c7-c1f75207995b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:07.664648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-1c94096b-8cae-41a1-85c7-c1f75207995b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:07.671153 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1c94096b-8cae-41a1-85c7-c1f75207995b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:07.671612 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1c94096b-8cae-41a1-85c7-c1f75207995b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:07.672380 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1c94096b-8cae-41a1-85c7-c1f75207995b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:07.672825 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1c94096b-8cae-41a1-85c7-c1f75207995b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:07.821179 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-1c94096b-8cae-41a1-85c7-c1f75207995b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:07.828683 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-1c94096b-8cae-41a1-85c7-c1f75207995b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.168937 Jul 25 06:02:07.829253 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 279/552] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:07 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:07.834164 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0e946794-d8c6-4f52-a912-81a55c3fd4a4 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:07.835091 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0e946794-d8c6-4f52-a912-81a55c3fd4a4 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:07.841866 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0e946794-d8c6-4f52-a912-81a55c3fd4a4 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:07.842673 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0e946794-d8c6-4f52-a912-81a55c3fd4a4 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:07.843711 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0e946794-d8c6-4f52-a912-81a55c3fd4a4 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:07.844517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0e946794-d8c6-4f52-a912-81a55c3fd4a4 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:08.027434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5db1e8d9-1cc2-4a7a-b985-3a0825517dd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:08.028080 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5db1e8d9-1cc2-4a7a-b985-3a0825517dd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:08.034737 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5db1e8d9-1cc2-4a7a-b985-3a0825517dd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:08.035263 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5db1e8d9-1cc2-4a7a-b985-3a0825517dd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:08.036128 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5db1e8d9-1cc2-4a7a-b985-3a0825517dd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:08.037461 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5db1e8d9-1cc2-4a7a-b985-3a0825517dd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:08.057189 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0e946794-d8c6-4f52-a912-81a55c3fd4a4 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:08.072647 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0e946794-d8c6-4f52-a912-81a55c3fd4a4 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.241253 Jul 25 06:02:08.082448 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 274/553] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:07 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:08.193794 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5db1e8d9-1cc2-4a7a-b985-3a0825517dd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:08.202346 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5db1e8d9-1cc2-4a7a-b985-3a0825517dd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:08.203891 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5db1e8d9-1cc2-4a7a-b985-3a0825517dd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:08.205097 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5db1e8d9-1cc2-4a7a-b985-3a0825517dd3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.181603 Jul 25 06:02:08.205655 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 280/554] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:08 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:02:08.847751 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a90cff8a-bcf2-4cb6-905d-c8ef01786ede tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:08.848359 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a90cff8a-bcf2-4cb6-905d-c8ef01786ede tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:08.856052 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a90cff8a-bcf2-4cb6-905d-c8ef01786ede tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:08.856536 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a90cff8a-bcf2-4cb6-905d-c8ef01786ede tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:08.857331 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a90cff8a-bcf2-4cb6-905d-c8ef01786ede tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:08.857775 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a90cff8a-bcf2-4cb6-905d-c8ef01786ede tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:08.999517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-a90cff8a-bcf2-4cb6-905d-c8ef01786ede tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:09.009671 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a90cff8a-bcf2-4cb6-905d-c8ef01786ede tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.166985 Jul 25 06:02:09.010384 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 275/555] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:08 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:09.089151 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6ca77349-c189-4f32-8754-1a71224afaf6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:09.089750 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6ca77349-c189-4f32-8754-1a71224afaf6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:09.096419 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6ca77349-c189-4f32-8754-1a71224afaf6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:09.096751 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6ca77349-c189-4f32-8754-1a71224afaf6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:09.097519 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6ca77349-c189-4f32-8754-1a71224afaf6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:09.097947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6ca77349-c189-4f32-8754-1a71224afaf6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:09.223510 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-fe95e0c2-5742-4116-8b30-9871ea0f91f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:09.224124 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-fe95e0c2-5742-4116-8b30-9871ea0f91f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:09.230433 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fe95e0c2-5742-4116-8b30-9871ea0f91f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:09.230933 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fe95e0c2-5742-4116-8b30-9871ea0f91f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:09.231780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fe95e0c2-5742-4116-8b30-9871ea0f91f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:09.232308 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fe95e0c2-5742-4116-8b30-9871ea0f91f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:09.232968 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6ca77349-c189-4f32-8754-1a71224afaf6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:09.242867 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6ca77349-c189-4f32-8754-1a71224afaf6 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.157404 Jul 25 06:02:09.243510 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 281/556] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:09 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:09.364602 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-fe95e0c2-5742-4116-8b30-9871ea0f91f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:09.373175 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-fe95e0c2-5742-4116-8b30-9871ea0f91f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:09.374855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-fe95e0c2-5742-4116-8b30-9871ea0f91f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:09.376007 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-fe95e0c2-5742-4116-8b30-9871ea0f91f9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.156418 Jul 25 06:02:09.376563 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 276/557] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:09 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:02:10.026855 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7eb5902c-9f94-4f07-b200-4bd5c408c98c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:10.027374 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7eb5902c-9f94-4f07-b200-4bd5c408c98c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:10.034037 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7eb5902c-9f94-4f07-b200-4bd5c408c98c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:10.034659 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7eb5902c-9f94-4f07-b200-4bd5c408c98c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:10.035580 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7eb5902c-9f94-4f07-b200-4bd5c408c98c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:10.036030 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7eb5902c-9f94-4f07-b200-4bd5c408c98c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:10.054698 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=100 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:10.172393 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7eb5902c-9f94-4f07-b200-4bd5c408c98c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:10.180616 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-7eb5902c-9f94-4f07-b200-4bd5c408c98c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.157809 Jul 25 06:02:10.181199 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 282/558] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:10 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:10.260724 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e1f80309-32ce-44c4-a14c-6275c8018633 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:10.261507 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e1f80309-32ce-44c4-a14c-6275c8018633 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:10.268775 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e1f80309-32ce-44c4-a14c-6275c8018633 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:10.274668 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e1f80309-32ce-44c4-a14c-6275c8018633 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:10.274668 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e1f80309-32ce-44c4-a14c-6275c8018633 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:10.274668 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e1f80309-32ce-44c4-a14c-6275c8018633 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:10.400469 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c6964d3a-c19b-4b6e-8f9c-85461a695e6e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:10.400469 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c6964d3a-c19b-4b6e-8f9c-85461a695e6e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:10.403104 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c6964d3a-c19b-4b6e-8f9c-85461a695e6e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:10.403769 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c6964d3a-c19b-4b6e-8f9c-85461a695e6e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:10.404546 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c6964d3a-c19b-4b6e-8f9c-85461a695e6e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:10.404975 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c6964d3a-c19b-4b6e-8f9c-85461a695e6e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:10.450832 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e1f80309-32ce-44c4-a14c-6275c8018633 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:10.458807 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e1f80309-32ce-44c4-a14c-6275c8018633 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.202741 Jul 25 06:02:10.459476 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 277/559] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:10 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:10.866396 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-c6964d3a-c19b-4b6e-8f9c-85461a695e6e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:10.875321 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-c6964d3a-c19b-4b6e-8f9c-85461a695e6e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:10.876812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-c6964d3a-c19b-4b6e-8f9c-85461a695e6e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:10.877963 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c6964d3a-c19b-4b6e-8f9c-85461a695e6e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.486187 Jul 25 06:02:10.878528 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 283/560] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:10 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:11.197790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-c12da345-3baf-4da7-bc35-c6f7053bfb57 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:11.198436 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-c12da345-3baf-4da7-bc35-c6f7053bfb57 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:11.204535 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c12da345-3baf-4da7-bc35-c6f7053bfb57 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:11.204984 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c12da345-3baf-4da7-bc35-c6f7053bfb57 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:11.205745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c12da345-3baf-4da7-bc35-c6f7053bfb57 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:11.206178 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c12da345-3baf-4da7-bc35-c6f7053bfb57 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:11.348755 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-c12da345-3baf-4da7-bc35-c6f7053bfb57 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:11.356714 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-c12da345-3baf-4da7-bc35-c6f7053bfb57 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.163491 Jul 25 06:02:11.357276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 278/561] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:11 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:11.477491 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5bb3c96f-2d11-47dc-969d-f1d11192a644 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:11.478358 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5bb3c96f-2d11-47dc-969d-f1d11192a644 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:11.485166 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5bb3c96f-2d11-47dc-969d-f1d11192a644 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:11.485634 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5bb3c96f-2d11-47dc-969d-f1d11192a644 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:11.486389 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5bb3c96f-2d11-47dc-969d-f1d11192a644 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:11.486843 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5bb3c96f-2d11-47dc-969d-f1d11192a644 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:11.620213 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5bb3c96f-2d11-47dc-969d-f1d11192a644 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:11.627925 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5bb3c96f-2d11-47dc-969d-f1d11192a644 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.154927 Jul 25 06:02:11.632411 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 284/562] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:11 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:11.896568 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-5e935d54-4cb9-4954-be20-3fe7cce26905 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:11.897184 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-5e935d54-4cb9-4954-be20-3fe7cce26905 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:11.904485 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5e935d54-4cb9-4954-be20-3fe7cce26905 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:11.905185 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5e935d54-4cb9-4954-be20-3fe7cce26905 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:11.906192 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5e935d54-4cb9-4954-be20-3fe7cce26905 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:11.906640 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5e935d54-4cb9-4954-be20-3fe7cce26905 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:12.042883 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5e935d54-4cb9-4954-be20-3fe7cce26905 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:12.051374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5e935d54-4cb9-4954-be20-3fe7cce26905 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:12.052875 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5e935d54-4cb9-4954-be20-3fe7cce26905 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:12.054055 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-5e935d54-4cb9-4954-be20-3fe7cce26905 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.161585 Jul 25 06:02:12.054634 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 279/563] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:11 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:12.377248 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-902b06d7-1d04-4a4a-8fa9-4d069df77a12 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:12.378006 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-902b06d7-1d04-4a4a-8fa9-4d069df77a12 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:12.383864 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:12.385604 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-902b06d7-1d04-4a4a-8fa9-4d069df77a12 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:12.386119 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-902b06d7-1d04-4a4a-8fa9-4d069df77a12 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:12.387007 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-902b06d7-1d04-4a4a-8fa9-4d069df77a12 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:12.387507 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-902b06d7-1d04-4a4a-8fa9-4d069df77a12 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:12.527212 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-902b06d7-1d04-4a4a-8fa9-4d069df77a12 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:12.535398 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-902b06d7-1d04-4a4a-8fa9-4d069df77a12 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.163913 Jul 25 06:02:12.535977 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 285/564] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:12 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:12.645521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e2cff083-27bc-4d05-aa43-739e12137b2f tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:12.646167 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e2cff083-27bc-4d05-aa43-739e12137b2f tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:12.653522 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e2cff083-27bc-4d05-aa43-739e12137b2f tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:12.653961 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e2cff083-27bc-4d05-aa43-739e12137b2f tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:12.654752 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e2cff083-27bc-4d05-aa43-739e12137b2f tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:12.655181 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e2cff083-27bc-4d05-aa43-739e12137b2f tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:12.799811 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e2cff083-27bc-4d05-aa43-739e12137b2f tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:12.814305 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e2cff083-27bc-4d05-aa43-739e12137b2f tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.173234 Jul 25 06:02:12.814954 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 280/565] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:12 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:13.073487 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7be32794-bc57-4763-a2a4-acd63fcd47a3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:13.074118 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7be32794-bc57-4763-a2a4-acd63fcd47a3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:13.075966 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=2 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:13.080846 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7be32794-bc57-4763-a2a4-acd63fcd47a3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:13.081291 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7be32794-bc57-4763-a2a4-acd63fcd47a3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:13.082051 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7be32794-bc57-4763-a2a4-acd63fcd47a3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:13.082495 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7be32794-bc57-4763-a2a4-acd63fcd47a3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:13.178631 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=8 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:13.221982 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7be32794-bc57-4763-a2a4-acd63fcd47a3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:13.230371 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7be32794-bc57-4763-a2a4-acd63fcd47a3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:13.231884 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7be32794-bc57-4763-a2a4-acd63fcd47a3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:13.233032 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-7be32794-bc57-4763-a2a4-acd63fcd47a3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.164074 Jul 25 06:02:13.233585 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 286/566] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:13 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:13.554657 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-35c949ef-d9ca-40fd-8907-fd19ef53f364 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:13.556457 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-35c949ef-d9ca-40fd-8907-fd19ef53f364 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:13.562859 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-35c949ef-d9ca-40fd-8907-fd19ef53f364 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:13.563206 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-35c949ef-d9ca-40fd-8907-fd19ef53f364 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:13.563852 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-35c949ef-d9ca-40fd-8907-fd19ef53f364 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:13.564400 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-35c949ef-d9ca-40fd-8907-fd19ef53f364 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:13.714226 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-35c949ef-d9ca-40fd-8907-fd19ef53f364 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:13.722993 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-35c949ef-d9ca-40fd-8907-fd19ef53f364 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.172538 Jul 25 06:02:13.723581 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 281/567] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:13 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:13.831438 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5d9b6be5-c2e5-4718-98cb-a93f03453274 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:13.832161 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5d9b6be5-c2e5-4718-98cb-a93f03453274 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:13.839307 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5d9b6be5-c2e5-4718-98cb-a93f03453274 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:13.839956 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5d9b6be5-c2e5-4718-98cb-a93f03453274 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:13.840722 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5d9b6be5-c2e5-4718-98cb-a93f03453274 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:13.841150 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5d9b6be5-c2e5-4718-98cb-a93f03453274 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:13.982417 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5d9b6be5-c2e5-4718-98cb-a93f03453274 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:13.990202 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5d9b6be5-c2e5-4718-98cb-a93f03453274 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.162594 Jul 25 06:02:13.991039 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 287/568] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:13 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:14.251414 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-354997c1-f7d9-4591-86b7-18f3fc96f948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:14.252184 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-354997c1-f7d9-4591-86b7-18f3fc96f948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:14.259051 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-354997c1-f7d9-4591-86b7-18f3fc96f948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:14.259572 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-354997c1-f7d9-4591-86b7-18f3fc96f948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:14.260574 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-354997c1-f7d9-4591-86b7-18f3fc96f948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:14.260955 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-354997c1-f7d9-4591-86b7-18f3fc96f948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:14.400104 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-201d8f08-9330-446a-97de-7566217c00b9 req-ae7976f3-8ea1-44dd-bbae-a2679e124b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "348f256d-41e5-47d8-b165-cad6dfcd0be9", "name": "network-vif-plugged", "status": "completed", "tag": "f9f7f9cc-3fd7-49f4-b8f2-59f247cf93e3"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:14.404739 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-354997c1-f7d9-4591-86b7-18f3fc96f948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:14.412296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-201d8f08-9330-446a-97de-7566217c00b9 req-ae7976f3-8ea1-44dd-bbae-a2679e124b8a service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:14.412957 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-201d8f08-9330-446a-97de-7566217c00b9 req-ae7976f3-8ea1-44dd-bbae-a2679e124b8a service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:14.419620 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-354997c1-f7d9-4591-86b7-18f3fc96f948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:14.421485 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-354997c1-f7d9-4591-86b7-18f3fc96f948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:14.423247 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-354997c1-f7d9-4591-86b7-18f3fc96f948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.175847 Jul 25 06:02:14.425379 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 282/569] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:14 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:14.442265 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-201d8f08-9330-446a-97de-7566217c00b9 req-ae7976f3-8ea1-44dd-bbae-a2679e124b8a service nova] Creating event network-vif-plugged:f9f7f9cc-3fd7-49f4-b8f2-59f247cf93e3 for instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 on hv-cinder-85083 Jul 25 06:02:14.448031 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-201d8f08-9330-446a-97de-7566217c00b9 req-ae7976f3-8ea1-44dd-bbae-a2679e124b8a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054443 Jul 25 06:02:14.448739 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 288/570] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:14.740094 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-db85abb2-41b3-408b-9fe6-a2d670851a2b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:14.740699 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-db85abb2-41b3-408b-9fe6-a2d670851a2b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:14.748252 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-db85abb2-41b3-408b-9fe6-a2d670851a2b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:14.748706 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-db85abb2-41b3-408b-9fe6-a2d670851a2b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:14.749489 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-db85abb2-41b3-408b-9fe6-a2d670851a2b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:14.749924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-db85abb2-41b3-408b-9fe6-a2d670851a2b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:14.918128 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-db85abb2-41b3-408b-9fe6-a2d670851a2b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:14.926436 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-db85abb2-41b3-408b-9fe6-a2d670851a2b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.190336 Jul 25 06:02:14.927052 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 283/571] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:14 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:15.008714 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d7f4d040-3d70-4731-93de-5f3b058980e9 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:15.009413 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d7f4d040-3d70-4731-93de-5f3b058980e9 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:15.015598 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d7f4d040-3d70-4731-93de-5f3b058980e9 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:15.016041 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d7f4d040-3d70-4731-93de-5f3b058980e9 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:15.016806 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d7f4d040-3d70-4731-93de-5f3b058980e9 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:15.017235 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d7f4d040-3d70-4731-93de-5f3b058980e9 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:15.175954 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d7f4d040-3d70-4731-93de-5f3b058980e9 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:15.184800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d7f4d040-3d70-4731-93de-5f3b058980e9 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.180748 Jul 25 06:02:15.185531 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 289/572] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:15 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:15.442431 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3c680360-ad5a-4a19-b30e-4cc833feb9ca tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:15.443090 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3c680360-ad5a-4a19-b30e-4cc833feb9ca tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:15.449765 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3c680360-ad5a-4a19-b30e-4cc833feb9ca tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:15.450212 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3c680360-ad5a-4a19-b30e-4cc833feb9ca tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:15.451130 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3c680360-ad5a-4a19-b30e-4cc833feb9ca tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:15.451601 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3c680360-ad5a-4a19-b30e-4cc833feb9ca tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:15.471162 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=100 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:15.588046 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3c680360-ad5a-4a19-b30e-4cc833feb9ca tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:15.596619 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3c680360-ad5a-4a19-b30e-4cc833feb9ca tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:15.598115 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3c680360-ad5a-4a19-b30e-4cc833feb9ca tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:15.599427 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3c680360-ad5a-4a19-b30e-4cc833feb9ca tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.160867 Jul 25 06:02:15.599985 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 284/573] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:15 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:15.943668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7891f10d-19e0-4324-952b-4734c4621a92 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:15.944264 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7891f10d-19e0-4324-952b-4734c4621a92 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:15.950279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7891f10d-19e0-4324-952b-4734c4621a92 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:15.950916 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7891f10d-19e0-4324-952b-4734c4621a92 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:15.951725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7891f10d-19e0-4324-952b-4734c4621a92 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:15.952171 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7891f10d-19e0-4324-952b-4734c4621a92 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:16.083459 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7891f10d-19e0-4324-952b-4734c4621a92 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:16.091086 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-7891f10d-19e0-4324-952b-4734c4621a92 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.151333 Jul 25 06:02:16.091644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 290/574] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:15 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:16.201161 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-522f87fd-1b45-45c0-9ac4-cb0cbb26fc39 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:16.201735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-522f87fd-1b45-45c0-9ac4-cb0cbb26fc39 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:16.208454 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-522f87fd-1b45-45c0-9ac4-cb0cbb26fc39 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:16.208987 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-522f87fd-1b45-45c0-9ac4-cb0cbb26fc39 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:16.209791 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-522f87fd-1b45-45c0-9ac4-cb0cbb26fc39 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:16.210221 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-522f87fd-1b45-45c0-9ac4-cb0cbb26fc39 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:16.337986 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-522f87fd-1b45-45c0-9ac4-cb0cbb26fc39 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:16.345292 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-522f87fd-1b45-45c0-9ac4-cb0cbb26fc39 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.148125 Jul 25 06:02:16.345847 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 285/575] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:16 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:16.617497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-dd2d76d4-e75f-4e95-992c-079efcadd75d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:16.618190 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-dd2d76d4-e75f-4e95-992c-079efcadd75d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:16.626149 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dd2d76d4-e75f-4e95-992c-079efcadd75d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:16.626628 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dd2d76d4-e75f-4e95-992c-079efcadd75d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:16.627541 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dd2d76d4-e75f-4e95-992c-079efcadd75d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:16.627981 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dd2d76d4-e75f-4e95-992c-079efcadd75d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:16.763795 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-dd2d76d4-e75f-4e95-992c-079efcadd75d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:16.772052 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-dd2d76d4-e75f-4e95-992c-079efcadd75d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:16.773558 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-dd2d76d4-e75f-4e95-992c-079efcadd75d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:16.774734 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-dd2d76d4-e75f-4e95-992c-079efcadd75d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.161144 Jul 25 06:02:16.775321 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 291/576] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:16 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:17.108464 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-12ea9f2c-e312-492e-a947-2f56e479a5f8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:17.109074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-12ea9f2c-e312-492e-a947-2f56e479a5f8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:17.114957 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-12ea9f2c-e312-492e-a947-2f56e479a5f8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:17.115395 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-12ea9f2c-e312-492e-a947-2f56e479a5f8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:17.116325 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-12ea9f2c-e312-492e-a947-2f56e479a5f8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:17.116550 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-12ea9f2c-e312-492e-a947-2f56e479a5f8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:17.246112 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-12ea9f2c-e312-492e-a947-2f56e479a5f8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:17.253595 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-12ea9f2c-e312-492e-a947-2f56e479a5f8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.149530 Jul 25 06:02:17.254154 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 286/577] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:17 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:17.361960 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ccdf8689-8b1e-4cf9-b535-f0ad34c9d802 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:17.362517 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ccdf8689-8b1e-4cf9-b535-f0ad34c9d802 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:17.368983 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ccdf8689-8b1e-4cf9-b535-f0ad34c9d802 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:17.369981 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ccdf8689-8b1e-4cf9-b535-f0ad34c9d802 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:17.370771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ccdf8689-8b1e-4cf9-b535-f0ad34c9d802 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:17.371203 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ccdf8689-8b1e-4cf9-b535-f0ad34c9d802 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:17.502014 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ccdf8689-8b1e-4cf9-b535-f0ad34c9d802 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:17.509581 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ccdf8689-8b1e-4cf9-b535-f0ad34c9d802 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.151430 Jul 25 06:02:17.510154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 292/578] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:17 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:17.795114 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9e1778f8-7705-4252-9404-e7c35f11c080 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:17.795646 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-9e1778f8-7705-4252-9404-e7c35f11c080 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:17.797491 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=64 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:17.802933 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9e1778f8-7705-4252-9404-e7c35f11c080 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:17.803424 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9e1778f8-7705-4252-9404-e7c35f11c080 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:17.804190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9e1778f8-7705-4252-9404-e7c35f11c080 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:17.804775 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9e1778f8-7705-4252-9404-e7c35f11c080 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:17.940291 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-9e1778f8-7705-4252-9404-e7c35f11c080 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:17.948642 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-9e1778f8-7705-4252-9404-e7c35f11c080 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:17.950141 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-9e1778f8-7705-4252-9404-e7c35f11c080 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:17.951326 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-9e1778f8-7705-4252-9404-e7c35f11c080 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.160201 Jul 25 06:02:17.951885 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 287/579] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:17 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:18.271059 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4a15a9dc-44d9-4ca7-8d96-ef008d484c00 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:18.272658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4a15a9dc-44d9-4ca7-8d96-ef008d484c00 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:18.277729 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4a15a9dc-44d9-4ca7-8d96-ef008d484c00 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:18.278183 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4a15a9dc-44d9-4ca7-8d96-ef008d484c00 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:18.278967 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4a15a9dc-44d9-4ca7-8d96-ef008d484c00 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:18.279437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4a15a9dc-44d9-4ca7-8d96-ef008d484c00 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:18.408726 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4a15a9dc-44d9-4ca7-8d96-ef008d484c00 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:18.417715 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4a15a9dc-44d9-4ca7-8d96-ef008d484c00 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.150539 Jul 25 06:02:18.418271 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 293/580] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:18 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:18.525558 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ce4a5359-fbe2-477b-a923-4c90c967b90e tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:18.526804 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ce4a5359-fbe2-477b-a923-4c90c967b90e tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:18.533275 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ce4a5359-fbe2-477b-a923-4c90c967b90e tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:18.533720 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ce4a5359-fbe2-477b-a923-4c90c967b90e tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:18.534493 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ce4a5359-fbe2-477b-a923-4c90c967b90e tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:18.534937 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ce4a5359-fbe2-477b-a923-4c90c967b90e tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:18.661153 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ce4a5359-fbe2-477b-a923-4c90c967b90e tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:18.668818 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ce4a5359-fbe2-477b-a923-4c90c967b90e tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.147067 Jul 25 06:02:18.669386 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 288/581] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:18 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:18.969071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5b58b7d5-b5c0-4d53-9cb5-971280e7d4bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:18.969678 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5b58b7d5-b5c0-4d53-9cb5-971280e7d4bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:18.975611 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5b58b7d5-b5c0-4d53-9cb5-971280e7d4bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:18.976056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5b58b7d5-b5c0-4d53-9cb5-971280e7d4bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:18.976811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5b58b7d5-b5c0-4d53-9cb5-971280e7d4bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:18.977244 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5b58b7d5-b5c0-4d53-9cb5-971280e7d4bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:19.111096 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5b58b7d5-b5c0-4d53-9cb5-971280e7d4bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:19.119272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5b58b7d5-b5c0-4d53-9cb5-971280e7d4bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:19.121446 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5b58b7d5-b5c0-4d53-9cb5-971280e7d4bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:19.122629 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5b58b7d5-b5c0-4d53-9cb5-971280e7d4bf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.157362 Jul 25 06:02:19.123177 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 294/582] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:18 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:19.435004 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-37f2b09e-a5d4-4983-928d-9e96d1feedfa tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:19.435623 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-37f2b09e-a5d4-4983-928d-9e96d1feedfa tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:19.441686 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-37f2b09e-a5d4-4983-928d-9e96d1feedfa tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:19.442132 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-37f2b09e-a5d4-4983-928d-9e96d1feedfa tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:19.442926 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-37f2b09e-a5d4-4983-928d-9e96d1feedfa tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:19.443360 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-37f2b09e-a5d4-4983-928d-9e96d1feedfa tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:19.581240 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-37f2b09e-a5d4-4983-928d-9e96d1feedfa tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:19.588707 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-37f2b09e-a5d4-4983-928d-9e96d1feedfa tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.158162 Jul 25 06:02:19.589502 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 289/583] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:19 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:19.685024 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6f2697ba-e0bc-403e-8de3-da74688df6f3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:19.685574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6f2697ba-e0bc-403e-8de3-da74688df6f3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:19.691894 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6f2697ba-e0bc-403e-8de3-da74688df6f3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:19.692364 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6f2697ba-e0bc-403e-8de3-da74688df6f3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:19.693120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6f2697ba-e0bc-403e-8de3-da74688df6f3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:19.693549 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6f2697ba-e0bc-403e-8de3-da74688df6f3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:19.830844 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6f2697ba-e0bc-403e-8de3-da74688df6f3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:19.838089 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6f2697ba-e0bc-403e-8de3-da74688df6f3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.156955 Jul 25 06:02:19.838682 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 295/584] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:19 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:20.140599 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9c793e3a-7bec-4f85-8cb5-acc51fdd9ba6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:20.141209 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-9c793e3a-7bec-4f85-8cb5-acc51fdd9ba6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:20.147175 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9c793e3a-7bec-4f85-8cb5-acc51fdd9ba6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:20.147619 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9c793e3a-7bec-4f85-8cb5-acc51fdd9ba6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:20.148367 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9c793e3a-7bec-4f85-8cb5-acc51fdd9ba6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:20.148797 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9c793e3a-7bec-4f85-8cb5-acc51fdd9ba6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:20.279171 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-9c793e3a-7bec-4f85-8cb5-acc51fdd9ba6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:20.287600 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-9c793e3a-7bec-4f85-8cb5-acc51fdd9ba6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:20.289392 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-9c793e3a-7bec-4f85-8cb5-acc51fdd9ba6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:20.290571 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-9c793e3a-7bec-4f85-8cb5-acc51fdd9ba6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.153806 Jul 25 06:02:20.291133 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 290/585] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:20 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:20.610611 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-72016e1e-9b51-4dd1-a45f-87de880e157f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:20.610611 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-72016e1e-9b51-4dd1-a45f-87de880e157f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:20.612225 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-72016e1e-9b51-4dd1-a45f-87de880e157f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:20.612669 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-72016e1e-9b51-4dd1-a45f-87de880e157f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:20.613426 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-72016e1e-9b51-4dd1-a45f-87de880e157f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:20.613859 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-72016e1e-9b51-4dd1-a45f-87de880e157f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:20.749841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-72016e1e-9b51-4dd1-a45f-87de880e157f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:20.757693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-72016e1e-9b51-4dd1-a45f-87de880e157f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.156379 Jul 25 06:02:20.758327 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 296/586] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:20 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:20.854866 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9ec1b136-5990-4e17-b34a-e4b9fb2dc7df tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:20.855481 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-9ec1b136-5990-4e17-b34a-e4b9fb2dc7df tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:20.861962 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9ec1b136-5990-4e17-b34a-e4b9fb2dc7df tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:20.862348 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9ec1b136-5990-4e17-b34a-e4b9fb2dc7df tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:20.863154 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9ec1b136-5990-4e17-b34a-e4b9fb2dc7df tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:20.863586 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9ec1b136-5990-4e17-b34a-e4b9fb2dc7df tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:20.993183 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-9ec1b136-5990-4e17-b34a-e4b9fb2dc7df tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:21.000651 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-9ec1b136-5990-4e17-b34a-e4b9fb2dc7df tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.149664 Jul 25 06:02:21.001206 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 291/587] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:20 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:21.308329 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b754f5be-5fab-4351-8e1a-e4c6b7d707ef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:21.308937 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b754f5be-5fab-4351-8e1a-e4c6b7d707ef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:21.315037 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b754f5be-5fab-4351-8e1a-e4c6b7d707ef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:21.315482 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b754f5be-5fab-4351-8e1a-e4c6b7d707ef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:21.316293 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b754f5be-5fab-4351-8e1a-e4c6b7d707ef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:21.316725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b754f5be-5fab-4351-8e1a-e4c6b7d707ef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:21.446489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b754f5be-5fab-4351-8e1a-e4c6b7d707ef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:21.454802 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b754f5be-5fab-4351-8e1a-e4c6b7d707ef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:21.456288 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b754f5be-5fab-4351-8e1a-e4c6b7d707ef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:21.457428 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b754f5be-5fab-4351-8e1a-e4c6b7d707ef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.153626 Jul 25 06:02:21.457978 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 297/588] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:21 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:21.775294 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3926c073-4f07-4d55-8417-1bf1cd8138d9 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:21.776927 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3926c073-4f07-4d55-8417-1bf1cd8138d9 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:21.782312 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3926c073-4f07-4d55-8417-1bf1cd8138d9 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:21.782791 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3926c073-4f07-4d55-8417-1bf1cd8138d9 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:21.783547 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3926c073-4f07-4d55-8417-1bf1cd8138d9 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:21.783971 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3926c073-4f07-4d55-8417-1bf1cd8138d9 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:22.017442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-fbce9815-9a2f-4257-b40f-d234aa411e39 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:22.018002 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-fbce9815-9a2f-4257-b40f-d234aa411e39 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:22.024872 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fbce9815-9a2f-4257-b40f-d234aa411e39 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:22.025318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fbce9815-9a2f-4257-b40f-d234aa411e39 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:22.026725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fbce9815-9a2f-4257-b40f-d234aa411e39 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:22.027184 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fbce9815-9a2f-4257-b40f-d234aa411e39 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:22.157474 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3926c073-4f07-4d55-8417-1bf1cd8138d9 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:22.163587 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-fbce9815-9a2f-4257-b40f-d234aa411e39 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:22.165451 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3926c073-4f07-4d55-8417-1bf1cd8138d9 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.394846 Jul 25 06:02:22.166873 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 292/589] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:21 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:22.176675 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-fbce9815-9a2f-4257-b40f-d234aa411e39 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.163263 Jul 25 06:02:22.180828 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 298/590] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:22 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:22.475459 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2b40c8c6-5934-46eb-985c-9b8121c06dc6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:22.476076 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2b40c8c6-5934-46eb-985c-9b8121c06dc6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:22.482060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2b40c8c6-5934-46eb-985c-9b8121c06dc6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:22.482535 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2b40c8c6-5934-46eb-985c-9b8121c06dc6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:22.483295 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2b40c8c6-5934-46eb-985c-9b8121c06dc6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:22.483728 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2b40c8c6-5934-46eb-985c-9b8121c06dc6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:22.610151 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2b40c8c6-5934-46eb-985c-9b8121c06dc6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:22.618699 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2b40c8c6-5934-46eb-985c-9b8121c06dc6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:22.620738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2b40c8c6-5934-46eb-985c-9b8121c06dc6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:22.621901 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2b40c8c6-5934-46eb-985c-9b8121c06dc6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.150439 Jul 25 06:02:22.622453 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 293/591] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:22 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:23.183529 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8cbbe519-a327-440a-9389-1964c792882c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:23.184144 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8cbbe519-a327-440a-9389-1964c792882c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:23.190664 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8cbbe519-a327-440a-9389-1964c792882c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:23.191111 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8cbbe519-a327-440a-9389-1964c792882c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:23.191870 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8cbbe519-a327-440a-9389-1964c792882c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:23.192302 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8cbbe519-a327-440a-9389-1964c792882c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:23.196228 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e2318d49-7981-400d-8eb1-ce1930810ec1 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:23.196862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e2318d49-7981-400d-8eb1-ce1930810ec1 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:23.204190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e2318d49-7981-400d-8eb1-ce1930810ec1 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:23.204635 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e2318d49-7981-400d-8eb1-ce1930810ec1 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:23.205397 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e2318d49-7981-400d-8eb1-ce1930810ec1 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:23.205830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e2318d49-7981-400d-8eb1-ce1930810ec1 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:23.325695 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8cbbe519-a327-440a-9389-1964c792882c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:23.329337 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=100 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:23.334049 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e2318d49-7981-400d-8eb1-ce1930810ec1 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:23.334207 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8cbbe519-a327-440a-9389-1964c792882c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.154975 Jul 25 06:02:23.334918 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 299/592] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:23 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:23.341624 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e2318d49-7981-400d-8eb1-ce1930810ec1 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.149121 Jul 25 06:02:23.346276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 294/593] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:23 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:23.646045 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-02f7d97f-0c26-4030-aa37-7c2244828951 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:23.646707 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-02f7d97f-0c26-4030-aa37-7c2244828951 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:23.652781 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-02f7d97f-0c26-4030-aa37-7c2244828951 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:23.653271 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-02f7d97f-0c26-4030-aa37-7c2244828951 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:23.653984 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-02f7d97f-0c26-4030-aa37-7c2244828951 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:23.654418 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-02f7d97f-0c26-4030-aa37-7c2244828951 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:23.784945 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-02f7d97f-0c26-4030-aa37-7c2244828951 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:23.793764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-02f7d97f-0c26-4030-aa37-7c2244828951 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:23.795323 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-02f7d97f-0c26-4030-aa37-7c2244828951 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:23.796463 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-02f7d97f-0c26-4030-aa37-7c2244828951 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1806 microversion: 2.20 time: 0.154644 Jul 25 06:02:23.797016 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 300/594] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:23 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:24.133263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-07277a26-51ff-43ff-b88c-840fb653a90b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:24.133748 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-07277a26-51ff-43ff-b88c-840fb653a90b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:24.139840 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-07277a26-51ff-43ff-b88c-840fb653a90b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.140277 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-07277a26-51ff-43ff-b88c-840fb653a90b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.141019 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-07277a26-51ff-43ff-b88c-840fb653a90b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.141439 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-07277a26-51ff-43ff-b88c-840fb653a90b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.164755 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-07277a26-51ff-43ff-b88c-840fb653a90b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff/ips" status: 200 len: 149 microversion: 2.1 time: 0.035323 Jul 25 06:02:24.165360 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 295/595] 10.222.0.17 () {58 vars in 1247 bytes} [Mon Jul 25 06:02:24 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:24.176151 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2f8e7107-d1c0-41c8-9a69-22474923b92d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e1c5ae7-4d6f-4170-8bc3-d2e10017e9fd"}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:24.177273 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2f8e7107-d1c0-41c8-9a69-22474923b92d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:24.183202 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2f8e7107-d1c0-41c8-9a69-22474923b92d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.183642 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2f8e7107-d1c0-41c8-9a69-22474923b92d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.184388 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2f8e7107-d1c0-41c8-9a69-22474923b92d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.184814 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2f8e7107-d1c0-41c8-9a69-22474923b92d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.262683 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-2f8e7107-d1c0-41c8-9a69-22474923b92d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] HTTP exception thrown: Invalid volume: volume 0e1c5ae7-4d6f-4170-8bc3-d2e10017e9fd is already attached to instances: 479a7885-4c31-448b-8d0d-42049d47896f Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2f8e7107-d1c0-41c8-9a69-22474923b92d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Request method failure captured: Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: POST /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff/os-volume_attachments HTTP/1.1 Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 74 Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEaup3unl7LzCcXgiLIPWZjrIYFX_SDw7ELDXjOyj6m1AigSppJN7j_MZUlx8A8dXfMKGKjZXWqF1YnEL3IukuRzY_02IDqinPYsk5il0dKKd6-RpE31D5qPeu1-2vVhe6F2MsA703sX0YNFO-wEG6wXFh49_JEAsgi8VdOlbOfuBo Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:02:24.264406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:02:24.265995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_488e87a8233e4e69a07cd8efba37cad7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:02:24.265995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:02:24.265995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:02:24.265995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:02:24.265995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:02:24.265995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:02:24.265995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:02:24.265995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 6dc49525e3394668b4f1610c4badc144 Jul 25 06:02:24.265995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:02:24.265995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Jul 25 06:02:24.265995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {"volumeAttachment": {"volumeId": "0e1c5ae7-4d6f-4170-8bc3-d2e10017e9fd"}} Jul 25 06:02:24.265995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Invalid volume: volume 0e1c5ae7-4d6f-4170-8bc3-d2e10017e9fd is already attached to instances: 479a7885-4c31-448b-8d0d-42049d47896f Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'server_id': 'fb485129-6941-49db-9cee-c83f53f2bdff', 'body': {'volumeAttachment': {'volumeId': '0e1c5ae7-4d6f-4170-8bc3-d2e10017e9fd'}}} Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0e1c5ae7-4d6f-4170-8bc3-d2e10017e9fd is already attached to instances: 479a7885-4c31-448b-8d0d-42049d47896f Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:02:24.266851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0e1c5ae7-4d6f-4170-8bc3-d2e10017e9fd is already attached to instances: 479a7885-4c31-448b-8d0d-42049d47896f Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:24.268056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:02:24.269259 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:02:24.269259 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:02:24.269259 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:02:24.269259 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0e1c5ae7-4d6f-4170-8bc3-d2e10017e9fd is already attached to instances: 479a7885-4c31-448b-8d0d-42049d47896f Jul 25 06:02:24.269259 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:02:24.269259 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2f8e7107-d1c0-41c8-9a69-22474923b92d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Returning 400 to user: Invalid volume: volume 0e1c5ae7-4d6f-4170-8bc3-d2e10017e9fd is already attached to instances: 479a7885-4c31-448b-8d0d-42049d47896f {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:02:24.269259 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2f8e7107-d1c0-41c8-9a69-22474923b92d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "POST /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093599 Jul 25 06:02:24.269259 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 301/596] 10.222.0.17 () {60 vars in 1322 bytes} [Mon Jul 25 06:02:24 2022] POST /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 06:02:24.274819 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-7d0e7037-5529-4e65-8c18-fcba3c488e98 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:24.275318 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-7d0e7037-5529-4e65-8c18-fcba3c488e98 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:24.282426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7d0e7037-5529-4e65-8c18-fcba3c488e98 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.282918 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7d0e7037-5529-4e65-8c18-fcba3c488e98 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.283682 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7d0e7037-5529-4e65-8c18-fcba3c488e98 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.284115 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7d0e7037-5529-4e65-8c18-fcba3c488e98 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.308501 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-7d0e7037-5529-4e65-8c18-fcba3c488e98 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Going to try to terminate instance {{(pid=130162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:02:24.350279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-aede05d3-d700-4cab-a64e-ddf29bd1e806 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:24.358974 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-aede05d3-d700-4cab-a64e-ddf29bd1e806 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:24.358974 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aede05d3-d700-4cab-a64e-ddf29bd1e806 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.358974 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aede05d3-d700-4cab-a64e-ddf29bd1e806 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.360024 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aede05d3-d700-4cab-a64e-ddf29bd1e806 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.360473 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aede05d3-d700-4cab-a64e-ddf29bd1e806 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.492911 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-aede05d3-d700-4cab-a64e-ddf29bd1e806 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:24.501350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-aede05d3-d700-4cab-a64e-ddf29bd1e806 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.154855 Jul 25 06:02:24.502005 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 302/597] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:24 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:24.506951 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4c7c6d89-9d29-42f2-95cd-e216a0b19538 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:24.507555 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4c7c6d89-9d29-42f2-95cd-e216a0b19538 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:24.513469 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4c7c6d89-9d29-42f2-95cd-e216a0b19538 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.513918 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4c7c6d89-9d29-42f2-95cd-e216a0b19538 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.514853 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4c7c6d89-9d29-42f2-95cd-e216a0b19538 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.515277 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4c7c6d89-9d29-42f2-95cd-e216a0b19538 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.647067 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4c7c6d89-9d29-42f2-95cd-e216a0b19538 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:24.655341 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4c7c6d89-9d29-42f2-95cd-e216a0b19538 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.152192 Jul 25 06:02:24.655914 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 303/598] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:24 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:24.660473 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-145d7750-cec7-4549-b623-060656149dd7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:24.660958 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-145d7750-cec7-4549-b623-060656149dd7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:24.668057 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-7d0e7037-5529-4e65-8c18-fcba3c488e98 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 204 len: 0 microversion: 2.1 time: 0.396580 Jul 25 06:02:24.668987 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 296/599] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:02:24 2022] DELETE /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:02:24.677709 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-145d7750-cec7-4549-b623-060656149dd7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.678264 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-145d7750-cec7-4549-b623-060656149dd7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.679126 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-145d7750-cec7-4549-b623-060656149dd7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.679573 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-145d7750-cec7-4549-b623-060656149dd7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.679928 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b571345b-42c5-4b3d-b8c3-02eeba72f9c7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:24.680666 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b571345b-42c5-4b3d-b8c3-02eeba72f9c7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:24.687609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b571345b-42c5-4b3d-b8c3-02eeba72f9c7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.688214 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b571345b-42c5-4b3d-b8c3-02eeba72f9c7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.690907 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b571345b-42c5-4b3d-b8c3-02eeba72f9c7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.691372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b571345b-42c5-4b3d-b8c3-02eeba72f9c7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.811926 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.objects.instance [None req-145d7750-cec7-4549-b623-060656149dd7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lazy-loading 'services' on Instance uuid 0b706acf-4c08-4ea0-8086-3091278ad437 {{(pid=130163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:02:24.836272 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b571345b-42c5-4b3d-b8c3-02eeba72f9c7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:24.844265 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b571345b-42c5-4b3d-b8c3-02eeba72f9c7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1681 microversion: 2.1 time: 0.170190 Jul 25 06:02:24.844904 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 297/600] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:24 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:24.849360 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2c03625b-8a95-43b0-aa9b-1eb4983caf34 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:24.854933 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2c03625b-8a95-43b0-aa9b-1eb4983caf34 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:24.856505 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2c03625b-8a95-43b0-aa9b-1eb4983caf34 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.858645 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2c03625b-8a95-43b0-aa9b-1eb4983caf34 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.859417 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2c03625b-8a95-43b0-aa9b-1eb4983caf34 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.859844 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2c03625b-8a95-43b0-aa9b-1eb4983caf34 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.012253 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2c03625b-8a95-43b0-aa9b-1eb4983caf34 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:25.023078 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2c03625b-8a95-43b0-aa9b-1eb4983caf34 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:25.024635 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2c03625b-8a95-43b0-aa9b-1eb4983caf34 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:25.026413 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2c03625b-8a95-43b0-aa9b-1eb4983caf34 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1793 microversion: 2.20 time: 0.179907 Jul 25 06:02:25.027098 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 298/601] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:24 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1793 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:25.031444 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-31915341-771e-44be-aaa8-33f19704b629 req-b261c1f4-0beb-4faf-a75b-09671a404744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1007f9b0-08e2-4d72-91e9-586792d0695b", "name": "network-vif-plugged", "status": "completed", "tag": "3dfa9b78-4afb-4b3a-b13e-7a68f5d8ecc8"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:25.039770 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-31915341-771e-44be-aaa8-33f19704b629 req-b261c1f4-0beb-4faf-a75b-09671a404744 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:25.040214 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-31915341-771e-44be-aaa8-33f19704b629 req-b261c1f4-0beb-4faf-a75b-09671a404744 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.050641 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-31915341-771e-44be-aaa8-33f19704b629 req-b261c1f4-0beb-4faf-a75b-09671a404744 service nova] Creating event network-vif-plugged:3dfa9b78-4afb-4b3a-b13e-7a68f5d8ecc8 for instance 1007f9b0-08e2-4d72-91e9-586792d0695b on hv-cinder-85083 Jul 25 06:02:25.055431 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-31915341-771e-44be-aaa8-33f19704b629 req-b261c1f4-0beb-4faf-a75b-09671a404744 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027250 Jul 25 06:02:25.056174 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 299/602] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:25.060871 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-145d7750-cec7-4549-b623-060656149dd7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/os-volume_attachments/cc40c569-4115-4cb6-9fa4-d4bfb3619a76" status: 202 len: 0 microversion: 2.1 time: 0.403613 Jul 25 06:02:25.061278 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 304/603] 10.222.0.17 () {58 vars in 1415 bytes} [Mon Jul 25 06:02:24 2022] DELETE /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/os-volume_attachments/cc40c569-4115-4cb6-9fa4-d4bfb3619a76 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:02:25.518958 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d3e73682-5bb5-4706-b895-12b37475e346 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:25.519618 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d3e73682-5bb5-4706-b895-12b37475e346 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:25.526180 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d3e73682-5bb5-4706-b895-12b37475e346 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:25.526657 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d3e73682-5bb5-4706-b895-12b37475e346 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.527408 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d3e73682-5bb5-4706-b895-12b37475e346 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:25.527836 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d3e73682-5bb5-4706-b895-12b37475e346 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.545919 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:25.657174 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d3e73682-5bb5-4706-b895-12b37475e346 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:25.664774 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d3e73682-5bb5-4706-b895-12b37475e346 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.150554 Jul 25 06:02:25.665330 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 300/604] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:25 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:25.674115 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9376f23f-57b1-4b02-bc23-fca0221258a2 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:25.674839 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-9376f23f-57b1-4b02-bc23-fca0221258a2 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:25.681483 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9376f23f-57b1-4b02-bc23-fca0221258a2 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:25.685216 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9376f23f-57b1-4b02-bc23-fca0221258a2 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.685216 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9376f23f-57b1-4b02-bc23-fca0221258a2 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:25.685216 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9376f23f-57b1-4b02-bc23-fca0221258a2 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.824905 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9376f23f-57b1-4b02-bc23-fca0221258a2 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:25.832418 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9376f23f-57b1-4b02-bc23-fca0221258a2 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.162935 Jul 25 06:02:25.832977 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 305/605] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:25 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:25.863512 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6839ec15-c4b0-4e68-9d36-071aa52cc9e4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:25.864198 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-6839ec15-c4b0-4e68-9d36-071aa52cc9e4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:25.871243 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6839ec15-c4b0-4e68-9d36-071aa52cc9e4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:25.871774 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6839ec15-c4b0-4e68-9d36-071aa52cc9e4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.872652 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6839ec15-c4b0-4e68-9d36-071aa52cc9e4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:25.873094 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6839ec15-c4b0-4e68-9d36-071aa52cc9e4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:26.006415 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-6839ec15-c4b0-4e68-9d36-071aa52cc9e4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:26.014207 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-6839ec15-c4b0-4e68-9d36-071aa52cc9e4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1681 microversion: 2.1 time: 0.154983 Jul 25 06:02:26.014804 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 301/606] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:25 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:26.681474 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-72833be1-2cae-4675-ac05-991029b10be5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:26.681998 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-72833be1-2cae-4675-ac05-991029b10be5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:26.688441 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-72833be1-2cae-4675-ac05-991029b10be5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:26.688911 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-72833be1-2cae-4675-ac05-991029b10be5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:26.689661 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-72833be1-2cae-4675-ac05-991029b10be5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:26.690084 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-72833be1-2cae-4675-ac05-991029b10be5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:26.820109 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-72833be1-2cae-4675-ac05-991029b10be5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:26.828395 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-72833be1-2cae-4675-ac05-991029b10be5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.150899 Jul 25 06:02:26.828986 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 306/607] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:26 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:26.848886 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-49b3218b-1093-48fe-8572-3f57a04c0406 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:26.849508 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-49b3218b-1093-48fe-8572-3f57a04c0406 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:26.855998 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-49b3218b-1093-48fe-8572-3f57a04c0406 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:26.856445 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-49b3218b-1093-48fe-8572-3f57a04c0406 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:26.857204 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-49b3218b-1093-48fe-8572-3f57a04c0406 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:26.857641 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-49b3218b-1093-48fe-8572-3f57a04c0406 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:26.985562 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-49b3218b-1093-48fe-8572-3f57a04c0406 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:26.992975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-49b3218b-1093-48fe-8572-3f57a04c0406 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.147877 Jul 25 06:02:26.993552 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 302/608] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:26 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:27.031156 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e8ff2fcd-f403-4d3c-864d-45f833c179c4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:27.031900 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e8ff2fcd-f403-4d3c-864d-45f833c179c4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:27.038006 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e8ff2fcd-f403-4d3c-864d-45f833c179c4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:27.038558 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e8ff2fcd-f403-4d3c-864d-45f833c179c4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:27.039656 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e8ff2fcd-f403-4d3c-864d-45f833c179c4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:27.040152 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e8ff2fcd-f403-4d3c-864d-45f833c179c4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:27.071757 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-dc40e596-21b0-41fe-aa6b-15c62f50b009 req-b39fe4df-bcaf-4410-b42b-50bb7f540f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404", "name": "network-vif-plugged", "status": "completed", "tag": "b64f5129-42ac-424a-aa95-8c9a29c2d5dc"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:27.079871 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-dc40e596-21b0-41fe-aa6b-15c62f50b009 req-b39fe4df-bcaf-4410-b42b-50bb7f540f95 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:27.080307 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-dc40e596-21b0-41fe-aa6b-15c62f50b009 req-b39fe4df-bcaf-4410-b42b-50bb7f540f95 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:27.091982 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-dc40e596-21b0-41fe-aa6b-15c62f50b009 req-b39fe4df-bcaf-4410-b42b-50bb7f540f95 service nova] Creating event network-vif-plugged:b64f5129-42ac-424a-aa95-8c9a29c2d5dc for instance 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 on hv-cinder-85083 Jul 25 06:02:27.096797 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-dc40e596-21b0-41fe-aa6b-15c62f50b009 req-b39fe4df-bcaf-4410-b42b-50bb7f540f95 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029320 Jul 25 06:02:27.097557 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 303/609] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:02:27.180721 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e8ff2fcd-f403-4d3c-864d-45f833c179c4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:27.188338 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e8ff2fcd-f403-4d3c-864d-45f833c179c4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1681 microversion: 2.1 time: 0.161500 Jul 25 06:02:27.188840 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 307/610] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:27 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:27.846270 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-187e126c-4039-4c4a-9da6-5ecc3deeb66e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:27.847063 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-187e126c-4039-4c4a-9da6-5ecc3deeb66e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:27.853672 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-187e126c-4039-4c4a-9da6-5ecc3deeb66e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:27.854240 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-187e126c-4039-4c4a-9da6-5ecc3deeb66e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:27.854914 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-187e126c-4039-4c4a-9da6-5ecc3deeb66e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:27.855354 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-187e126c-4039-4c4a-9da6-5ecc3deeb66e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:27.992626 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-187e126c-4039-4c4a-9da6-5ecc3deeb66e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:28.000786 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-187e126c-4039-4c4a-9da6-5ecc3deeb66e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.158928 Jul 25 06:02:28.001464 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 304/611] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:27 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:28.012215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f32ad7d1-d0f9-4174-a04e-c7804414a33d tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:28.012914 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f32ad7d1-d0f9-4174-a04e-c7804414a33d tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:28.026079 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f32ad7d1-d0f9-4174-a04e-c7804414a33d tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:28.026669 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f32ad7d1-d0f9-4174-a04e-c7804414a33d tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:28.027655 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f32ad7d1-d0f9-4174-a04e-c7804414a33d tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:28.028241 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f32ad7d1-d0f9-4174-a04e-c7804414a33d tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:28.167219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f32ad7d1-d0f9-4174-a04e-c7804414a33d tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:28.174674 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f32ad7d1-d0f9-4174-a04e-c7804414a33d tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.166399 Jul 25 06:02:28.175236 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 308/612] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:28 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:28.205578 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-7f78a527-17f6-48f1-8746-91eaea0dd7f2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:28.206194 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-7f78a527-17f6-48f1-8746-91eaea0dd7f2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:28.212157 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7f78a527-17f6-48f1-8746-91eaea0dd7f2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:28.212605 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7f78a527-17f6-48f1-8746-91eaea0dd7f2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:28.213363 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7f78a527-17f6-48f1-8746-91eaea0dd7f2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:28.213795 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7f78a527-17f6-48f1-8746-91eaea0dd7f2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:28.352777 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-7f78a527-17f6-48f1-8746-91eaea0dd7f2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:28.360176 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-7f78a527-17f6-48f1-8746-91eaea0dd7f2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1681 microversion: 2.1 time: 0.158492 Jul 25 06:02:28.360738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 305/613] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:28 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:29.017562 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a72887a1-e470-4b2d-899e-c50481559568 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:29.018203 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a72887a1-e470-4b2d-899e-c50481559568 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:29.024642 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a72887a1-e470-4b2d-899e-c50481559568 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:29.025091 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a72887a1-e470-4b2d-899e-c50481559568 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:29.025840 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a72887a1-e470-4b2d-899e-c50481559568 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:29.026270 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a72887a1-e470-4b2d-899e-c50481559568 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:29.152793 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a72887a1-e470-4b2d-899e-c50481559568 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:29.160658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a72887a1-e470-4b2d-899e-c50481559568 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.146857 Jul 25 06:02:29.161160 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 309/614] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:29 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:29.191084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-11b965dd-b77d-4d4e-a7bb-a21ad8e5f79e tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:29.191697 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-11b965dd-b77d-4d4e-a7bb-a21ad8e5f79e tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:29.198240 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-11b965dd-b77d-4d4e-a7bb-a21ad8e5f79e tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:29.198714 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-11b965dd-b77d-4d4e-a7bb-a21ad8e5f79e tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:29.199473 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-11b965dd-b77d-4d4e-a7bb-a21ad8e5f79e tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:29.199907 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-11b965dd-b77d-4d4e-a7bb-a21ad8e5f79e tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:29.327078 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-11b965dd-b77d-4d4e-a7bb-a21ad8e5f79e tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:29.334340 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-11b965dd-b77d-4d4e-a7bb-a21ad8e5f79e tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.146982 Jul 25 06:02:29.334920 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 306/615] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:29 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:29.376650 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f1176d52-9cd1-48cf-969c-802f418c7536 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:29.377269 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f1176d52-9cd1-48cf-969c-802f418c7536 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:29.383170 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f1176d52-9cd1-48cf-969c-802f418c7536 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:29.383616 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f1176d52-9cd1-48cf-969c-802f418c7536 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:29.384374 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f1176d52-9cd1-48cf-969c-802f418c7536 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:29.384807 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f1176d52-9cd1-48cf-969c-802f418c7536 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:29.514547 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f1176d52-9cd1-48cf-969c-802f418c7536 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:29.522026 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f1176d52-9cd1-48cf-969c-802f418c7536 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1681 microversion: 2.1 time: 0.149223 Jul 25 06:02:29.522610 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 310/616] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:29 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:30.177172 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a0945a89-c494-46c7-8a7e-3cd3c123eb7b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:30.177930 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a0945a89-c494-46c7-8a7e-3cd3c123eb7b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:30.183879 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a0945a89-c494-46c7-8a7e-3cd3c123eb7b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:30.184339 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a0945a89-c494-46c7-8a7e-3cd3c123eb7b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:30.185757 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a0945a89-c494-46c7-8a7e-3cd3c123eb7b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:30.186194 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a0945a89-c494-46c7-8a7e-3cd3c123eb7b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:30.352461 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9e716cf4-ca7d-42d8-8723-4575f9549c83 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:30.353129 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-9e716cf4-ca7d-42d8-8723-4575f9549c83 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:30.361547 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9e716cf4-ca7d-42d8-8723-4575f9549c83 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:30.366510 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9e716cf4-ca7d-42d8-8723-4575f9549c83 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:30.366510 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9e716cf4-ca7d-42d8-8723-4575f9549c83 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:30.366510 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9e716cf4-ca7d-42d8-8723-4575f9549c83 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:30.463876 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-a0945a89-c494-46c7-8a7e-3cd3c123eb7b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:30.478966 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a0945a89-c494-46c7-8a7e-3cd3c123eb7b tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.305432 Jul 25 06:02:30.489018 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 307/617] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:30 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:30.499027 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-7aab3bc8-b9c8-4288-9d7b-2c56f721c9af tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:30.510394 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7aab3bc8-b9c8-4288-9d7b-2c56f721c9af tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:30.510980 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7aab3bc8-b9c8-4288-9d7b-2c56f721c9af tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:30.552797 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-7aab3bc8-b9c8-4288-9d7b-2c56f721c9af tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Going to try to stop instance {{(pid=130162) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 06:02:30.591833 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9e716cf4-ca7d-42d8-8723-4575f9549c83 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:30.600771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9e716cf4-ca7d-42d8-8723-4575f9549c83 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.253168 Jul 25 06:02:30.601335 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 311/618] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:30 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:30.606315 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9bba592e-282a-4b19-b714-b04274507dc8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:30.607680 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-9bba592e-282a-4b19-b714-b04274507dc8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:30.616725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9bba592e-282a-4b19-b714-b04274507dc8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:30.617442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9bba592e-282a-4b19-b714-b04274507dc8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:30.619734 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9bba592e-282a-4b19-b714-b04274507dc8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:30.620490 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9bba592e-282a-4b19-b714-b04274507dc8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:30.712998 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9bba592e-282a-4b19-b714-b04274507dc8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:30.722075 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9bba592e-282a-4b19-b714-b04274507dc8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1613 microversion: 2.1 time: 0.119437 Jul 25 06:02:30.722718 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 312/619] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:30 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1613 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:30.739199 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-ba68e43b-e5f4-4774-afef-cb9e8e182474 req-3a14dbe3-1ee3-4155-919c-f0d8c5f6232f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb485129-6941-49db-9cee-c83f53f2bdff", "name": "network-vif-deleted", "tag": "08aafc3d-895b-4cc7-84fd-174d4858268a"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:30.749733 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-ba68e43b-e5f4-4774-afef-cb9e8e182474 req-3a14dbe3-1ee3-4155-919c-f0d8c5f6232f service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:30.750417 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-ba68e43b-e5f4-4774-afef-cb9e8e182474 req-3a14dbe3-1ee3-4155-919c-f0d8c5f6232f service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:30.768884 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-ba68e43b-e5f4-4774-afef-cb9e8e182474 req-3a14dbe3-1ee3-4155-919c-f0d8c5f6232f service nova] Creating event network-vif-deleted:08aafc3d-895b-4cc7-84fd-174d4858268a for instance fb485129-6941-49db-9cee-c83f53f2bdff on hv-cinder-85083 Jul 25 06:02:30.774505 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-ba68e43b-e5f4-4774-afef-cb9e8e182474 req-3a14dbe3-1ee3-4155-919c-f0d8c5f6232f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039493 Jul 25 06:02:30.775121 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 313/620] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:30.819554 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-7aab3bc8-b9c8-4288-9d7b-2c56f721c9af tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "POST /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/action" status: 202 len: 0 microversion: 2.1 time: 0.328619 Jul 25 06:02:30.820680 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 308/621] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 06:02:30 2022] POST /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:02:30.829693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-65c0cea6-d98d-4170-b2ff-b01b3b42cd0c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:30.830654 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-65c0cea6-d98d-4170-b2ff-b01b3b42cd0c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:30.837225 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-65c0cea6-d98d-4170-b2ff-b01b3b42cd0c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:30.838063 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-65c0cea6-d98d-4170-b2ff-b01b3b42cd0c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:30.839206 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-65c0cea6-d98d-4170-b2ff-b01b3b42cd0c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:30.842678 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-65c0cea6-d98d-4170-b2ff-b01b3b42cd0c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:31.024550 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-65c0cea6-d98d-4170-b2ff-b01b3b42cd0c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:31.033947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-65c0cea6-d98d-4170-b2ff-b01b3b42cd0c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1726 microversion: 2.1 time: 0.209229 Jul 25 06:02:31.034766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 314/622] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:30 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1726 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:31.497106 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d6e63ec1-dfb5-4926-8380-26d048d6bf76 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:31.498184 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d6e63ec1-dfb5-4926-8380-26d048d6bf76 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:31.506112 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d6e63ec1-dfb5-4926-8380-26d048d6bf76 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:31.506597 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d6e63ec1-dfb5-4926-8380-26d048d6bf76 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:31.507420 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d6e63ec1-dfb5-4926-8380-26d048d6bf76 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:31.507822 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d6e63ec1-dfb5-4926-8380-26d048d6bf76 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:31.618302 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8d64a035-c10b-4eb9-9fc0-68df92d9cac8 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:31.619571 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8d64a035-c10b-4eb9-9fc0-68df92d9cac8 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:31.627295 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8d64a035-c10b-4eb9-9fc0-68df92d9cac8 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:31.627740 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8d64a035-c10b-4eb9-9fc0-68df92d9cac8 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:31.628692 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8d64a035-c10b-4eb9-9fc0-68df92d9cac8 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:31.629136 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8d64a035-c10b-4eb9-9fc0-68df92d9cac8 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:31.672780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d6e63ec1-dfb5-4926-8380-26d048d6bf76 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:31.683286 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d6e63ec1-dfb5-4926-8380-26d048d6bf76 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1259 microversion: 2.1 time: 0.191077 Jul 25 06:02:31.694225 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 309/623] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:31 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:31.742219 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cd6b3970-16d1-4fbd-9f78-9590086b2ad0 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:31.742951 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-cd6b3970-16d1-4fbd-9f78-9590086b2ad0 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:31.753163 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd6b3970-16d1-4fbd-9f78-9590086b2ad0 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:31.753163 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd6b3970-16d1-4fbd-9f78-9590086b2ad0 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:31.753163 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd6b3970-16d1-4fbd-9f78-9590086b2ad0 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:31.753163 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cd6b3970-16d1-4fbd-9f78-9590086b2ad0 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:31.787339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8d64a035-c10b-4eb9-9fc0-68df92d9cac8 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:31.796295 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8d64a035-c10b-4eb9-9fc0-68df92d9cac8 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1319 microversion: 2.1 time: 0.181817 Jul 25 06:02:31.797405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 315/624] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:31 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:31.850187 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cd6b3970-16d1-4fbd-9f78-9590086b2ad0 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:31.879228 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-cd6b3970-16d1-4fbd-9f78-9590086b2ad0 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1326 microversion: 2.1 time: 0.142594 Jul 25 06:02:31.881905 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 310/625] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:31 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1326 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:32.055139 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5d59dcce-4db8-4412-bf1f-41924c79ad0a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:32.056156 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5d59dcce-4db8-4412-bf1f-41924c79ad0a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:32.066159 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5d59dcce-4db8-4412-bf1f-41924c79ad0a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:32.066765 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5d59dcce-4db8-4412-bf1f-41924c79ad0a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:32.067660 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5d59dcce-4db8-4412-bf1f-41924c79ad0a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:32.068326 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5d59dcce-4db8-4412-bf1f-41924c79ad0a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:32.097400 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:32.227273 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5d59dcce-4db8-4412-bf1f-41924c79ad0a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:32.235826 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5d59dcce-4db8-4412-bf1f-41924c79ad0a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1680 microversion: 2.1 time: 0.186435 Jul 25 06:02:32.236403 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 316/626] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:32 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:32.700352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cf0efc62-c546-465e-8184-2e1c731d750f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:32.701559 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-cf0efc62-c546-465e-8184-2e1c731d750f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:32.708695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cf0efc62-c546-465e-8184-2e1c731d750f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:32.709151 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cf0efc62-c546-465e-8184-2e1c731d750f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:32.709966 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cf0efc62-c546-465e-8184-2e1c731d750f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:32.710405 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cf0efc62-c546-465e-8184-2e1c731d750f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:32.814554 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a04cae89-af4d-4bd9-9c63-284bbd361497 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:32.819279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a04cae89-af4d-4bd9-9c63-284bbd361497 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:32.827555 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a04cae89-af4d-4bd9-9c63-284bbd361497 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:32.828016 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a04cae89-af4d-4bd9-9c63-284bbd361497 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:32.828889 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a04cae89-af4d-4bd9-9c63-284bbd361497 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:32.829397 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a04cae89-af4d-4bd9-9c63-284bbd361497 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:32.878606 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cf0efc62-c546-465e-8184-2e1c731d750f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:32.886770 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-cf0efc62-c546-465e-8184-2e1c731d750f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1442 microversion: 2.1 time: 0.190323 Jul 25 06:02:32.887345 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 311/627] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:32 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1442 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:32.904296 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b43188cc-026b-4c0f-a7f2-41a1fbb8a625 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:32.908148 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b43188cc-026b-4c0f-a7f2-41a1fbb8a625 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:32.912462 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b43188cc-026b-4c0f-a7f2-41a1fbb8a625 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:32.913023 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b43188cc-026b-4c0f-a7f2-41a1fbb8a625 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:32.913860 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b43188cc-026b-4c0f-a7f2-41a1fbb8a625 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:32.914758 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b43188cc-026b-4c0f-a7f2-41a1fbb8a625 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:32.991620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a04cae89-af4d-4bd9-9c63-284bbd361497 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:32.999129 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a04cae89-af4d-4bd9-9c63-284bbd361497 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1508 microversion: 2.1 time: 0.189831 Jul 25 06:02:32.999930 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 317/628] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:32 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:33.015694 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7757d15e-53dc-42f3-9aaf-8ef7880f5088 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:33.016306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7757d15e-53dc-42f3-9aaf-8ef7880f5088 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:33.022412 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7757d15e-53dc-42f3-9aaf-8ef7880f5088 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:33.022959 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7757d15e-53dc-42f3-9aaf-8ef7880f5088 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:33.023662 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7757d15e-53dc-42f3-9aaf-8ef7880f5088 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:33.024104 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7757d15e-53dc-42f3-9aaf-8ef7880f5088 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:33.059989 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7757d15e-53dc-42f3-9aaf-8ef7880f5088 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:33.060467 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7757d15e-53dc-42f3-9aaf-8ef7880f5088 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:33.060916 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.objects.instance [None req-7757d15e-53dc-42f3-9aaf-8ef7880f5088 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lazy-loading 'fault' on Instance uuid fb485129-6941-49db-9cee-c83f53f2bdff {{(pid=130163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:02:33.069718 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b43188cc-026b-4c0f-a7f2-41a1fbb8a625 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:33.078430 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b43188cc-026b-4c0f-a7f2-41a1fbb8a625 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1442 microversion: 2.1 time: 0.178010 Jul 25 06:02:33.079234 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 312/629] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:32 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1442 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:33.084045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3ea246af-bf05-43d5-8556-369ea5a3d9c3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0be040f1-2816-49d3-a534-a1ffe4b1efc5", "device": "/dev/sdb"}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:33.087838 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3ea246af-bf05-43d5-8556-369ea5a3d9c3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:33.095011 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3ea246af-bf05-43d5-8556-369ea5a3d9c3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:33.095460 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3ea246af-bf05-43d5-8556-369ea5a3d9c3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:33.096597 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3ea246af-bf05-43d5-8556-369ea5a3d9c3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:33.097491 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3ea246af-bf05-43d5-8556-369ea5a3d9c3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:33.116775 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7757d15e-53dc-42f3-9aaf-8ef7880f5088 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:33.127923 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-7757d15e-53dc-42f3-9aaf-8ef7880f5088 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 200 len: 1331 microversion: 2.1 time: 0.115786 Jul 25 06:02:33.129668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 318/630] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:33 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:33.253316 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a2115759-63d4-4bcf-82e8-1cff7425c56b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:33.253928 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a2115759-63d4-4bcf-82e8-1cff7425c56b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:33.261194 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a2115759-63d4-4bcf-82e8-1cff7425c56b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:33.261785 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a2115759-63d4-4bcf-82e8-1cff7425c56b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:33.262415 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a2115759-63d4-4bcf-82e8-1cff7425c56b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:33.262879 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a2115759-63d4-4bcf-82e8-1cff7425c56b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:33.397984 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a2115759-63d4-4bcf-82e8-1cff7425c56b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:33.406171 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a2115759-63d4-4bcf-82e8-1cff7425c56b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1680 microversion: 2.1 time: 0.156812 Jul 25 06:02:33.406761 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 319/631] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:33 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:33.986672 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3ea246af-bf05-43d5-8556-369ea5a3d9c3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "POST /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.906261 Jul 25 06:02:33.992040 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 313/632] 10.222.0.17 () {60 vars in 1322 bytes} [Mon Jul 25 06:02:33 2022] POST /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404/os-volume_attachments => generated 194 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:34.147365 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7b98bd21-a450-49ce-a491-71670d1f9f10 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:34.148217 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7b98bd21-a450-49ce-a491-71670d1f9f10 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:34.155659 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7b98bd21-a450-49ce-a491-71670d1f9f10 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:34.156110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7b98bd21-a450-49ce-a491-71670d1f9f10 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:34.156883 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7b98bd21-a450-49ce-a491-71670d1f9f10 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:34.157323 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7b98bd21-a450-49ce-a491-71670d1f9f10 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:34.171236 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-7b98bd21-a450-49ce-a491-71670d1f9f10 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] HTTP exception thrown: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7b98bd21-a450-49ce-a491-71670d1f9f10 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Request method failure captured: Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff HTTP/1.1 Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEaup3unl7LzCcXgiLIPWZjrIYFX_SDw7ELDXjOyj6m1AigSppJN7j_MZUlx8A8dXfMKGKjZXWqF1YnEL3IukuRzY_02IDqinPYsk5il0dKKd6-RpE31D5qPeu1-2vVhe6F2MsA703sX0YNFO-wEG6wXFh49_JEAsgi8VdOlbOfuBo Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:02:34.173169 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:02:34.174908 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_488e87a8233e4e69a07cd8efba37cad7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:02:34.174908 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:02:34.174908 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:02:34.174908 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:02:34.174908 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:02:34.174908 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:02:34.174908 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:02:34.174908 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 6dc49525e3394668b4f1610c4badc144 Jul 25 06:02:34.174908 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:02:34.174908 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:02:34.174908 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. Jul 25 06:02:34.174908 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': 'fb485129-6941-49db-9cee-c83f53f2bdff'} Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:02:34.175658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. Jul 25 06:02:34.176898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:02:34.178126 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7b98bd21-a450-49ce-a491-71670d1f9f10 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Returning 404 to user: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:02:34.178126 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-7b98bd21-a450-49ce-a491-71670d1f9f10 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 404 len: 111 microversion: 2.1 time: 0.031353 Jul 25 06:02:34.188513 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1b52eca6-2261-46f3-b5e1-792d02f4d2af tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '.version_select at 0x7f9d35f3c0d0>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:34.188776 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 320/633] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:34 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:02:34.269312 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1b52eca6-2261-46f3-b5e1-792d02f4d2af tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091290031" status: 202 len: 0 microversion: 2.1 time: 0.088557 Jul 25 06:02:34.274353 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 314/634] 10.222.0.17 () {58 vars in 1220 bytes} [Mon Jul 25 06:02:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091290031 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:02:34.423270 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9ec49150-607a-416b-956d-0e22318efcf9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:34.423809 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-9ec49150-607a-416b-956d-0e22318efcf9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:34.429724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9ec49150-607a-416b-956d-0e22318efcf9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:34.431235 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9ec49150-607a-416b-956d-0e22318efcf9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:34.431235 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9ec49150-607a-416b-956d-0e22318efcf9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:34.431442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9ec49150-607a-416b-956d-0e22318efcf9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:34.575356 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9ec49150-607a-416b-956d-0e22318efcf9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:34.584175 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9ec49150-607a-416b-956d-0e22318efcf9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1680 microversion: 2.1 time: 0.164612 Jul 25 06:02:34.584757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 321/635] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:34 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:35.210379 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0b99d9cd-6ad6-43d1-9556-3ec44fdda6fd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:35.211019 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0b99d9cd-6ad6-43d1-9556-3ec44fdda6fd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:35.218822 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0b99d9cd-6ad6-43d1-9556-3ec44fdda6fd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:35.221683 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0b99d9cd-6ad6-43d1-9556-3ec44fdda6fd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:35.221683 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0b99d9cd-6ad6-43d1-9556-3ec44fdda6fd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:35.221683 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0b99d9cd-6ad6-43d1-9556-3ec44fdda6fd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:35.309387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-0b99d9cd-6ad6-43d1-9556-3ec44fdda6fd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lazy-loading 'services' on Instance uuid 479a7885-4c31-448b-8d0d-42049d47896f {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:02:35.458730 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:35.550999 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0b99d9cd-6ad6-43d1-9556-3ec44fdda6fd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "DELETE /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments/0e1c5ae7-4d6f-4170-8bc3-d2e10017e9fd" status: 202 len: 0 microversion: 2.1 time: 0.344309 Jul 25 06:02:35.551843 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 315/636] 10.222.0.17 () {58 vars in 1415 bytes} [Mon Jul 25 06:02:35 2022] DELETE /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments/0e1c5ae7-4d6f-4170-8bc3-d2e10017e9fd => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:02:35.559868 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-0917343b-be69-4686-86c0-e8001bec828b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:35.560940 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-0917343b-be69-4686-86c0-e8001bec828b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:35.568723 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0917343b-be69-4686-86c0-e8001bec828b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:35.569458 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0917343b-be69-4686-86c0-e8001bec828b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:35.570429 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0917343b-be69-4686-86c0-e8001bec828b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:35.571043 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0917343b-be69-4686-86c0-e8001bec828b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:35.612601 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d7eb5e85-8890-445d-aec6-d377dabd7e51 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:35.613658 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d7eb5e85-8890-445d-aec6-d377dabd7e51 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:35.623605 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-0917343b-be69-4686-86c0-e8001bec828b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065536 Jul 25 06:02:35.624495 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 322/637] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:02:35 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:35.628760 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d7eb5e85-8890-445d-aec6-d377dabd7e51 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:35.629462 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d7eb5e85-8890-445d-aec6-d377dabd7e51 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:35.630772 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d7eb5e85-8890-445d-aec6-d377dabd7e51 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:35.631393 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d7eb5e85-8890-445d-aec6-d377dabd7e51 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:35.658149 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-6bcb86bf-c6f0-41ef-b08f-58cbe49e1eac req-d7697e01-59af-404e-9632-b9dcb4c3141f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1007f9b0-08e2-4d72-91e9-586792d0695b", "tag": "3dfa9b78-4afb-4b3a-b13e-7a68f5d8ecc8"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:35.670371 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-6bcb86bf-c6f0-41ef-b08f-58cbe49e1eac req-d7697e01-59af-404e-9632-b9dcb4c3141f service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:35.671366 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-6bcb86bf-c6f0-41ef-b08f-58cbe49e1eac req-d7697e01-59af-404e-9632-b9dcb4c3141f service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:35.687163 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-6bcb86bf-c6f0-41ef-b08f-58cbe49e1eac req-d7697e01-59af-404e-9632-b9dcb4c3141f service nova] Creating event network-changed:3dfa9b78-4afb-4b3a-b13e-7a68f5d8ecc8 for instance 1007f9b0-08e2-4d72-91e9-586792d0695b on hv-cinder-85083 Jul 25 06:02:35.696780 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-6bcb86bf-c6f0-41ef-b08f-58cbe49e1eac req-d7697e01-59af-404e-9632-b9dcb4c3141f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043267 Jul 25 06:02:35.697961 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 323/638] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:02:35.835379 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d7eb5e85-8890-445d-aec6-d377dabd7e51 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:35.843407 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d7eb5e85-8890-445d-aec6-d377dabd7e51 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1680 microversion: 2.1 time: 0.236666 Jul 25 06:02:35.844159 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 316/639] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:35 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:36.637940 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-47e3fbf0-e522-4c03-80cf-3538cce84bed tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:36.640378 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-47e3fbf0-e522-4c03-80cf-3538cce84bed tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:36.648593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-47e3fbf0-e522-4c03-80cf-3538cce84bed tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:36.649271 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-47e3fbf0-e522-4c03-80cf-3538cce84bed tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:36.650761 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-47e3fbf0-e522-4c03-80cf-3538cce84bed tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:36.651375 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-47e3fbf0-e522-4c03-80cf-3538cce84bed tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:36.693523 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-47e3fbf0-e522-4c03-80cf-3538cce84bed tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062134 Jul 25 06:02:36.696836 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 324/640] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:02:36 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:36.861227 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-bd8f9468-c568-4d73-929e-86ca5beff07f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:36.861982 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-bd8f9468-c568-4d73-929e-86ca5beff07f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:36.868824 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bd8f9468-c568-4d73-929e-86ca5beff07f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:36.869388 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bd8f9468-c568-4d73-929e-86ca5beff07f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:36.870616 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bd8f9468-c568-4d73-929e-86ca5beff07f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:36.871109 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bd8f9468-c568-4d73-929e-86ca5beff07f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:37.068071 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-bd8f9468-c568-4d73-929e-86ca5beff07f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:37.076697 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-bd8f9468-c568-4d73-929e-86ca5beff07f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1680 microversion: 2.1 time: 0.220003 Jul 25 06:02:37.086427 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 317/641] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:36 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:37.705070 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-82e976de-27fe-485e-a6f1-00d7d3eb90af tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:37.705998 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-82e976de-27fe-485e-a6f1-00d7d3eb90af tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:37.713995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-82e976de-27fe-485e-a6f1-00d7d3eb90af tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:37.713995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-82e976de-27fe-485e-a6f1-00d7d3eb90af tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:37.713995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-82e976de-27fe-485e-a6f1-00d7d3eb90af tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:37.714353 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-82e976de-27fe-485e-a6f1-00d7d3eb90af tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:37.743885 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-82e976de-27fe-485e-a6f1-00d7d3eb90af tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042840 Jul 25 06:02:37.744683 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 325/642] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:02:37 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:38.093431 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-27d75292-4e0e-43ba-a95c-36e7d21e2fae tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:38.094049 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-27d75292-4e0e-43ba-a95c-36e7d21e2fae tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:38.100644 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-27d75292-4e0e-43ba-a95c-36e7d21e2fae tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:38.101090 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-27d75292-4e0e-43ba-a95c-36e7d21e2fae tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:38.101883 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-27d75292-4e0e-43ba-a95c-36e7d21e2fae tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:38.102319 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-27d75292-4e0e-43ba-a95c-36e7d21e2fae tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:38.228756 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-27d75292-4e0e-43ba-a95c-36e7d21e2fae tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:38.237602 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-27d75292-4e0e-43ba-a95c-36e7d21e2fae tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1680 microversion: 2.1 time: 0.148256 Jul 25 06:02:38.237850 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 318/643] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:38 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:38.736981 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4aa9548c-7210-495c-895a-8aec3fea4c16 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1621103960", "imageRef": "bfffd6ef-7f99-4a99-90f3-027fe9c89821", "flavorRef": "452"}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:38.755928 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e7f2f9cd-f0ca-4885-a7ed-8cc3fed2a2b7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:38.757109 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e7f2f9cd-f0ca-4885-a7ed-8cc3fed2a2b7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:38.763308 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e7f2f9cd-f0ca-4885-a7ed-8cc3fed2a2b7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:38.764258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e7f2f9cd-f0ca-4885-a7ed-8cc3fed2a2b7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:38.765011 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e7f2f9cd-f0ca-4885-a7ed-8cc3fed2a2b7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:38.765436 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e7f2f9cd-f0ca-4885-a7ed-8cc3fed2a2b7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:38.789451 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.network.neutron [None req-4aa9548c-7210-495c-895a-8aec3fea4c16 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] validate_networks() for None {{(pid=130163) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:02:38.797210 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e7f2f9cd-f0ca-4885-a7ed-8cc3fed2a2b7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045071 Jul 25 06:02:38.797767 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 319/644] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:02:38 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:02:39.053189 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-4aa9548c-7210-495c-895a-8aec3fea4c16 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Flavor limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:02:39.053601 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-4aa9548c-7210-495c-895a-8aec3fea4c16 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Image limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:02:39.054066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-4aa9548c-7210-495c-895a-8aec3fea4c16 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Flavor pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:02:39.054545 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-4aa9548c-7210-495c-895a-8aec3fea4c16 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Image pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:02:39.054950 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-4aa9548c-7210-495c-895a-8aec3fea4c16 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:02:39.064231 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4aa9548c-7210-495c-895a-8aec3fea4c16 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:39.064724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4aa9548c-7210-495c-895a-8aec3fea4c16 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:39.065826 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4aa9548c-7210-495c-895a-8aec3fea4c16 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:39.066429 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4aa9548c-7210-495c-895a-8aec3fea4c16 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:39.084234 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-4aa9548c-7210-495c-895a-8aec3fea4c16 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Getting quotas for project 30bfa024bb4a475e9f914d91f6d01a8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:02:39.088067 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-4aa9548c-7210-495c-895a-8aec3fea4c16 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Getting quotas for user a3e574d24a714fc4a0a2877b63829f26 and project 30bfa024bb4a475e9f914d91f6d01a8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:02:39.098599 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4aa9548c-7210-495c-895a-8aec3fea4c16 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Going to run 1 instances... {{(pid=130163) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:02:39.100790 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4aa9548c-7210-495c-895a-8aec3fea4c16 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfffd6ef-7f99-4a99-90f3-027fe9c89821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:02:39.254893 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2521ab89-459d-4122-9e60-ce424f537a31 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:39.255426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2521ab89-459d-4122-9e60-ce424f537a31 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:39.261906 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2521ab89-459d-4122-9e60-ce424f537a31 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:39.262352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2521ab89-459d-4122-9e60-ce424f537a31 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:39.263188 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2521ab89-459d-4122-9e60-ce424f537a31 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:39.263643 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2521ab89-459d-4122-9e60-ce424f537a31 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:39.285338 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4aa9548c-7210-495c-895a-8aec3fea4c16 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552121 Jul 25 06:02:39.286156 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 326/645] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 06:02:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:02:39.297581 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-60ad2ecf-ec20-4783-b0e2-45b1e13fddde tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:39.297581 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-60ad2ecf-ec20-4783-b0e2-45b1e13fddde tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:39.298803 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:39.367410 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-60ad2ecf-ec20-4783-b0e2-45b1e13fddde tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:39.378041 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-60ad2ecf-ec20-4783-b0e2-45b1e13fddde tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1215 microversion: 2.1 time: 0.085809 Jul 25 06:02:39.378950 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 327/646] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:39 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:39.425377 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2521ab89-459d-4122-9e60-ce424f537a31 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:39.434206 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2521ab89-459d-4122-9e60-ce424f537a31 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1680 microversion: 2.1 time: 0.183342 Jul 25 06:02:39.434838 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 320/647] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:39 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:39.809299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-08f40bbe-f777-4705-ab69-43a5ee87f042 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:39.810219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-08f40bbe-f777-4705-ab69-43a5ee87f042 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:39.816729 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-08f40bbe-f777-4705-ab69-43a5ee87f042 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:39.820824 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-08f40bbe-f777-4705-ab69-43a5ee87f042 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:39.820824 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-08f40bbe-f777-4705-ab69-43a5ee87f042 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:39.820824 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-08f40bbe-f777-4705-ab69-43a5ee87f042 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:39.848361 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-08f40bbe-f777-4705-ab69-43a5ee87f042 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043420 Jul 25 06:02:39.849065 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 328/648] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:02:39 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:02:40.395169 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f41e1e40-9847-4b67-a7d1-966a15c8a7a9 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:40.395784 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f41e1e40-9847-4b67-a7d1-966a15c8a7a9 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:40.402267 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f41e1e40-9847-4b67-a7d1-966a15c8a7a9 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:40.406167 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f41e1e40-9847-4b67-a7d1-966a15c8a7a9 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:40.406167 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f41e1e40-9847-4b67-a7d1-966a15c8a7a9 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:40.406167 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f41e1e40-9847-4b67-a7d1-966a15c8a7a9 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:40.452461 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3a1bbb0f-8066-4b36-b378-b423b9095cd7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:40.453075 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-3a1bbb0f-8066-4b36-b378-b423b9095cd7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:40.459048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3a1bbb0f-8066-4b36-b378-b423b9095cd7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:40.459502 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3a1bbb0f-8066-4b36-b378-b423b9095cd7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:40.460268 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3a1bbb0f-8066-4b36-b378-b423b9095cd7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:40.460710 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3a1bbb0f-8066-4b36-b378-b423b9095cd7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:40.471015 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-f41e1e40-9847-4b67-a7d1-966a15c8a7a9 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:40.478436 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f41e1e40-9847-4b67-a7d1-966a15c8a7a9 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1219 microversion: 2.1 time: 0.087038 Jul 25 06:02:40.479037 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 321/649] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:40 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:40.587770 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3a1bbb0f-8066-4b36-b378-b423b9095cd7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:40.599646 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-3a1bbb0f-8066-4b36-b378-b423b9095cd7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1680 microversion: 2.1 time: 0.151243 Jul 25 06:02:40.602854 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 329/650] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:40 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:40.860220 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-48a7e563-9d66-4277-880b-62ad7d4be187 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:40.861181 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-48a7e563-9d66-4277-880b-62ad7d4be187 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:40.867255 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-48a7e563-9d66-4277-880b-62ad7d4be187 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:40.867705 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-48a7e563-9d66-4277-880b-62ad7d4be187 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:40.868463 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-48a7e563-9d66-4277-880b-62ad7d4be187 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:40.868895 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-48a7e563-9d66-4277-880b-62ad7d4be187 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:40.897416 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-48a7e563-9d66-4277-880b-62ad7d4be187 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041236 Jul 25 06:02:40.898071 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 322/651] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:02:40 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:41.495069 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-94d09632-8cf5-40b7-8f81-c06e6b48b234 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:41.495673 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-94d09632-8cf5-40b7-8f81-c06e6b48b234 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:41.502766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-94d09632-8cf5-40b7-8f81-c06e6b48b234 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:41.503206 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-94d09632-8cf5-40b7-8f81-c06e6b48b234 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:41.505858 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-94d09632-8cf5-40b7-8f81-c06e6b48b234 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:41.505858 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-94d09632-8cf5-40b7-8f81-c06e6b48b234 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:41.564162 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-94d09632-8cf5-40b7-8f81-c06e6b48b234 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:41.571491 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-94d09632-8cf5-40b7-8f81-c06e6b48b234 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1211 microversion: 2.1 time: 0.080261 Jul 25 06:02:41.572041 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 330/652] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:41 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:41.616911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f123f970-ae93-4372-957d-8134a6f13ef9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:41.617530 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f123f970-ae93-4372-957d-8134a6f13ef9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:41.624828 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f123f970-ae93-4372-957d-8134a6f13ef9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:41.625277 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f123f970-ae93-4372-957d-8134a6f13ef9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:41.626043 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f123f970-ae93-4372-957d-8134a6f13ef9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:41.626496 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f123f970-ae93-4372-957d-8134a6f13ef9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:41.755745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-f123f970-ae93-4372-957d-8134a6f13ef9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:41.763596 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f123f970-ae93-4372-957d-8134a6f13ef9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1680 microversion: 2.1 time: 0.150461 Jul 25 06:02:41.764482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 323/653] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:41 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:41.913045 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-177b9161-f50e-49a1-a1fb-a29d9ff40526 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:41.913966 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-177b9161-f50e-49a1-a1fb-a29d9ff40526 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:41.920845 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-177b9161-f50e-49a1-a1fb-a29d9ff40526 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:41.921304 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-177b9161-f50e-49a1-a1fb-a29d9ff40526 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:41.922049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-177b9161-f50e-49a1-a1fb-a29d9ff40526 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:41.922497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-177b9161-f50e-49a1-a1fb-a29d9ff40526 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:41.951902 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-177b9161-f50e-49a1-a1fb-a29d9ff40526 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042684 Jul 25 06:02:41.952469 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 331/654] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:02:41 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:42.588573 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6b246f2a-9947-42ed-96fb-f9028e39299a tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:42.589196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-6b246f2a-9947-42ed-96fb-f9028e39299a tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:42.595214 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6b246f2a-9947-42ed-96fb-f9028e39299a tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:42.595664 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6b246f2a-9947-42ed-96fb-f9028e39299a tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:42.596480 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6b246f2a-9947-42ed-96fb-f9028e39299a tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:42.596917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6b246f2a-9947-42ed-96fb-f9028e39299a tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:42.659450 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-6b246f2a-9947-42ed-96fb-f9028e39299a tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:42.667113 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-6b246f2a-9947-42ed-96fb-f9028e39299a tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1267 microversion: 2.1 time: 0.082569 Jul 25 06:02:42.667679 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 324/655] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:42 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:42.780835 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9b148e9f-b288-4be2-94d0-7adee3ec4605 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:42.781373 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-9b148e9f-b288-4be2-94d0-7adee3ec4605 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:42.787733 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9b148e9f-b288-4be2-94d0-7adee3ec4605 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:42.788177 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9b148e9f-b288-4be2-94d0-7adee3ec4605 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:42.788925 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9b148e9f-b288-4be2-94d0-7adee3ec4605 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:42.789617 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9b148e9f-b288-4be2-94d0-7adee3ec4605 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:42.945561 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9b148e9f-b288-4be2-94d0-7adee3ec4605 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:42.954850 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9b148e9f-b288-4be2-94d0-7adee3ec4605 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1680 microversion: 2.1 time: 0.177776 Jul 25 06:02:42.964170 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 332/656] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:42 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:42.971215 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8c3430f8-88a1-4c92-8167-cfec56ad7f6b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:42.972243 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8c3430f8-88a1-4c92-8167-cfec56ad7f6b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:42.980124 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8c3430f8-88a1-4c92-8167-cfec56ad7f6b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:42.980641 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8c3430f8-88a1-4c92-8167-cfec56ad7f6b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:42.981774 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8c3430f8-88a1-4c92-8167-cfec56ad7f6b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:42.982935 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8c3430f8-88a1-4c92-8167-cfec56ad7f6b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:43.029633 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-8c3430f8-88a1-4c92-8167-cfec56ad7f6b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069896 Jul 25 06:02:43.030219 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 325/657] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:02:42 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:43.684074 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-114c14f7-4605-4ed4-8bba-57a49b485839 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:43.684601 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-114c14f7-4605-4ed4-8bba-57a49b485839 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:43.690833 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-114c14f7-4605-4ed4-8bba-57a49b485839 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:43.691463 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-114c14f7-4605-4ed4-8bba-57a49b485839 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:43.692237 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-114c14f7-4605-4ed4-8bba-57a49b485839 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:43.692669 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-114c14f7-4605-4ed4-8bba-57a49b485839 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:43.777727 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-114c14f7-4605-4ed4-8bba-57a49b485839 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:43.786935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-114c14f7-4605-4ed4-8bba-57a49b485839 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1273 microversion: 2.1 time: 0.106749 Jul 25 06:02:43.787575 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 333/658] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:43 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1273 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:43.971751 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-edca1857-604d-4c20-acdf-8305846dfd89 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:43.973262 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-edca1857-604d-4c20-acdf-8305846dfd89 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:43.978851 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-edca1857-604d-4c20-acdf-8305846dfd89 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:43.979295 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-edca1857-604d-4c20-acdf-8305846dfd89 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:43.980043 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-edca1857-604d-4c20-acdf-8305846dfd89 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:43.980472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-edca1857-604d-4c20-acdf-8305846dfd89 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:44.041603 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f9e3c246-7ae9-465a-812b-56c4d9311c92 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:44.042714 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f9e3c246-7ae9-465a-812b-56c4d9311c92 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:44.055673 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f9e3c246-7ae9-465a-812b-56c4d9311c92 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:44.056104 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f9e3c246-7ae9-465a-812b-56c4d9311c92 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:44.056880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f9e3c246-7ae9-465a-812b-56c4d9311c92 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:44.057314 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f9e3c246-7ae9-465a-812b-56c4d9311c92 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:44.091562 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f9e3c246-7ae9-465a-812b-56c4d9311c92 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054152 Jul 25 06:02:44.092415 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 334/659] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:02:44 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:44.118699 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-edca1857-604d-4c20-acdf-8305846dfd89 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:44.130692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-edca1857-604d-4c20-acdf-8305846dfd89 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1680 microversion: 2.1 time: 0.162666 Jul 25 06:02:44.131623 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 326/660] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:43 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:44.803681 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-78e50dc4-a32e-4da9-a1da-1a9ca29e08fd tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:44.804288 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-78e50dc4-a32e-4da9-a1da-1a9ca29e08fd tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:44.810895 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-78e50dc4-a32e-4da9-a1da-1a9ca29e08fd tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:44.811344 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-78e50dc4-a32e-4da9-a1da-1a9ca29e08fd tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:44.812103 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-78e50dc4-a32e-4da9-a1da-1a9ca29e08fd tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:44.813045 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-78e50dc4-a32e-4da9-a1da-1a9ca29e08fd tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:44.940764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-78e50dc4-a32e-4da9-a1da-1a9ca29e08fd tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:44.944134 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=100 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:44.948363 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-78e50dc4-a32e-4da9-a1da-1a9ca29e08fd tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1315 microversion: 2.1 time: 0.148550 Jul 25 06:02:44.948926 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 335/661] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:44 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:45.103638 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2a47ef81-9f16-4556-ba1c-4e6b4158954a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:45.104554 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2a47ef81-9f16-4556-ba1c-4e6b4158954a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:45.111857 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2a47ef81-9f16-4556-ba1c-4e6b4158954a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:45.112294 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2a47ef81-9f16-4556-ba1c-4e6b4158954a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:45.113076 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2a47ef81-9f16-4556-ba1c-4e6b4158954a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:45.113510 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2a47ef81-9f16-4556-ba1c-4e6b4158954a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:45.143551 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2a47ef81-9f16-4556-ba1c-4e6b4158954a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043714 Jul 25 06:02:45.144097 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 327/662] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:02:45 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:45.148703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2bb3bd6e-3fd8-4d17-80ab-d2ea38e87710 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:45.149317 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2bb3bd6e-3fd8-4d17-80ab-d2ea38e87710 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:45.155291 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2bb3bd6e-3fd8-4d17-80ab-d2ea38e87710 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:45.155736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2bb3bd6e-3fd8-4d17-80ab-d2ea38e87710 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:45.156522 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2bb3bd6e-3fd8-4d17-80ab-d2ea38e87710 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:45.156948 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2bb3bd6e-3fd8-4d17-80ab-d2ea38e87710 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:45.280884 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2bb3bd6e-3fd8-4d17-80ab-d2ea38e87710 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:45.288242 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2bb3bd6e-3fd8-4d17-80ab-d2ea38e87710 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1680 microversion: 2.1 time: 0.143751 Jul 25 06:02:45.288804 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 336/663] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:45 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1680 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:45.964730 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-28113570-29e9-4a88-abd0-75de88f37a21 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:45.965350 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-28113570-29e9-4a88-abd0-75de88f37a21 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:45.971391 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28113570-29e9-4a88-abd0-75de88f37a21 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:45.971842 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28113570-29e9-4a88-abd0-75de88f37a21 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:45.972603 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28113570-29e9-4a88-abd0-75de88f37a21 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:45.973037 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28113570-29e9-4a88-abd0-75de88f37a21 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:46.109321 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-28113570-29e9-4a88-abd0-75de88f37a21 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:46.117627 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-28113570-29e9-4a88-abd0-75de88f37a21 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1315 microversion: 2.1 time: 0.156842 Jul 25 06:02:46.118184 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 328/664] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:45 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:46.155131 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b1203ec0-6892-43ad-bb4c-9f7876fafc9f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:46.155977 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b1203ec0-6892-43ad-bb4c-9f7876fafc9f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:46.162903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b1203ec0-6892-43ad-bb4c-9f7876fafc9f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:46.163343 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b1203ec0-6892-43ad-bb4c-9f7876fafc9f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:46.164088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b1203ec0-6892-43ad-bb4c-9f7876fafc9f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:46.164772 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b1203ec0-6892-43ad-bb4c-9f7876fafc9f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:46.192971 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b1203ec0-6892-43ad-bb4c-9f7876fafc9f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041867 Jul 25 06:02:46.193508 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 337/665] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:02:46 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:46.305283 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d629ffbc-449d-42ee-ab58-7052c72ee76b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:46.306124 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d629ffbc-449d-42ee-ab58-7052c72ee76b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:46.312713 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d629ffbc-449d-42ee-ab58-7052c72ee76b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:46.313273 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d629ffbc-449d-42ee-ab58-7052c72ee76b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:46.314780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d629ffbc-449d-42ee-ab58-7052c72ee76b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:46.315305 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d629ffbc-449d-42ee-ab58-7052c72ee76b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:46.469414 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d629ffbc-449d-42ee-ab58-7052c72ee76b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:46.477149 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d629ffbc-449d-42ee-ab58-7052c72ee76b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1680 microversion: 2.1 time: 0.175862 Jul 25 06:02:46.477801 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 329/666] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:46 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:47.040558 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-410f4744-7fe0-4bfc-a168-b0f661102159 req-7097724e-6816-49e5-a9fd-3d5dd3ab1e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "507ef3a5-7e3d-4526-af62-3cb140646d2d", "tag": "6954bd34-b5f3-4680-80af-8ff2ba489e07"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:47.051650 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-410f4744-7fe0-4bfc-a168-b0f661102159 req-7097724e-6816-49e5-a9fd-3d5dd3ab1e0c service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:47.052102 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-410f4744-7fe0-4bfc-a168-b0f661102159 req-7097724e-6816-49e5-a9fd-3d5dd3ab1e0c service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:47.063418 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-410f4744-7fe0-4bfc-a168-b0f661102159 req-7097724e-6816-49e5-a9fd-3d5dd3ab1e0c service nova] Creating event network-changed:6954bd34-b5f3-4680-80af-8ff2ba489e07 for instance 507ef3a5-7e3d-4526-af62-3cb140646d2d on hv-cinder-85083 Jul 25 06:02:47.072968 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-410f4744-7fe0-4bfc-a168-b0f661102159 req-7097724e-6816-49e5-a9fd-3d5dd3ab1e0c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036433 Jul 25 06:02:47.073582 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 338/667] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:47.135739 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-bb7c8873-bbe7-4c87-a864-6b61454891ec tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:47.136841 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-bb7c8873-bbe7-4c87-a864-6b61454891ec tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:47.145885 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bb7c8873-bbe7-4c87-a864-6b61454891ec tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:47.146465 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bb7c8873-bbe7-4c87-a864-6b61454891ec tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:47.147602 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bb7c8873-bbe7-4c87-a864-6b61454891ec tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:47.148148 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bb7c8873-bbe7-4c87-a864-6b61454891ec tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:47.205397 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c992b1a5-5aeb-4cbc-b32b-afcada5e8fe8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:47.207004 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c992b1a5-5aeb-4cbc-b32b-afcada5e8fe8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:47.219783 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c992b1a5-5aeb-4cbc-b32b-afcada5e8fe8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:47.220786 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c992b1a5-5aeb-4cbc-b32b-afcada5e8fe8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:47.221598 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c992b1a5-5aeb-4cbc-b32b-afcada5e8fe8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:47.222183 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c992b1a5-5aeb-4cbc-b32b-afcada5e8fe8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:47.265404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c992b1a5-5aeb-4cbc-b32b-afcada5e8fe8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064572 Jul 25 06:02:47.266491 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 339/668] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:02:47 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 06:02:47.306633 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-bb7c8873-bbe7-4c87-a864-6b61454891ec tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:47.320745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-bb7c8873-bbe7-4c87-a864-6b61454891ec tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1315 microversion: 2.1 time: 0.186361 Jul 25 06:02:47.320745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 330/669] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:47 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:47.331929 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8e27bdaf-7dda-4209-b17d-630594ada0c9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:47.332429 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8e27bdaf-7dda-4209-b17d-630594ada0c9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:47.338924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8e27bdaf-7dda-4209-b17d-630594ada0c9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:47.339434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8e27bdaf-7dda-4209-b17d-630594ada0c9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:47.340419 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8e27bdaf-7dda-4209-b17d-630594ada0c9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:47.340854 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8e27bdaf-7dda-4209-b17d-630594ada0c9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:47.368562 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8e27bdaf-7dda-4209-b17d-630594ada0c9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Going to try to terminate instance {{(pid=130163) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:02:47.495128 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-dab1100d-0fd8-46e8-9148-a7a878890b15 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:47.495649 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-dab1100d-0fd8-46e8-9148-a7a878890b15 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:47.501976 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dab1100d-0fd8-46e8-9148-a7a878890b15 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:47.502424 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dab1100d-0fd8-46e8-9148-a7a878890b15 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:47.503226 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dab1100d-0fd8-46e8-9148-a7a878890b15 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:47.503660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dab1100d-0fd8-46e8-9148-a7a878890b15 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:47.654366 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-dab1100d-0fd8-46e8-9148-a7a878890b15 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:47.662911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-dab1100d-0fd8-46e8-9148-a7a878890b15 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1680 microversion: 2.1 time: 0.171478 Jul 25 06:02:47.663832 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 331/670] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:47 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:47.665540 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8e27bdaf-7dda-4209-b17d-630594ada0c9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "DELETE /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 204 len: 0 microversion: 2.1 time: 0.335644 Jul 25 06:02:47.665540 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 340/671] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:02:47 2022] DELETE /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:02:47.679504 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-fc2630d7-4771-4260-910d-d160b49d2c8c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:47.680389 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-fc2630d7-4771-4260-910d-d160b49d2c8c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:47.687796 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fc2630d7-4771-4260-910d-d160b49d2c8c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:47.688237 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fc2630d7-4771-4260-910d-d160b49d2c8c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:47.689580 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fc2630d7-4771-4260-910d-d160b49d2c8c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:47.690013 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fc2630d7-4771-4260-910d-d160b49d2c8c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:47.866501 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-fc2630d7-4771-4260-910d-d160b49d2c8c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:47.874075 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-fc2630d7-4771-4260-910d-d160b49d2c8c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1680 microversion: 2.1 time: 0.199759 Jul 25 06:02:47.874717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 341/672] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:47 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:48.287465 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-307f7343-a31d-40cd-a18a-a4ec71c92049 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d546ea5e-e274-471a-a2ee-48cbdff9e469"}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:48.288533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-307f7343-a31d-40cd-a18a-a4ec71c92049 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:48.291280 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:48.295979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-307f7343-a31d-40cd-a18a-a4ec71c92049 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:48.296420 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-307f7343-a31d-40cd-a18a-a4ec71c92049 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:48.297175 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-307f7343-a31d-40cd-a18a-a4ec71c92049 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:48.297607 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-307f7343-a31d-40cd-a18a-a4ec71c92049 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:48.315224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=100 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:48.334000 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c92c8a88-ef8f-4e0a-b06b-7927b9f304f1 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:48.335112 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c92c8a88-ef8f-4e0a-b06b-7927b9f304f1 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:48.341602 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c92c8a88-ef8f-4e0a-b06b-7927b9f304f1 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:48.342049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c92c8a88-ef8f-4e0a-b06b-7927b9f304f1 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:48.343140 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c92c8a88-ef8f-4e0a-b06b-7927b9f304f1 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:48.343572 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c92c8a88-ef8f-4e0a-b06b-7927b9f304f1 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:48.470487 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-c92c8a88-ef8f-4e0a-b06b-7927b9f304f1 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:48.477724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c92c8a88-ef8f-4e0a-b06b-7927b9f304f1 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1315 microversion: 2.1 time: 0.148698 Jul 25 06:02:48.478289 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 342/673] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:48 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:48.680393 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-fbb004c2-e937-43a7-9488-99d1cf0db605 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:48.681007 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-fbb004c2-e937-43a7-9488-99d1cf0db605 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:48.686978 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fbb004c2-e937-43a7-9488-99d1cf0db605 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:48.687428 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fbb004c2-e937-43a7-9488-99d1cf0db605 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:48.688192 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fbb004c2-e937-43a7-9488-99d1cf0db605 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:48.688626 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fbb004c2-e937-43a7-9488-99d1cf0db605 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:48.817725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-fbb004c2-e937-43a7-9488-99d1cf0db605 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:48.825179 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-fbb004c2-e937-43a7-9488-99d1cf0db605 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1657 microversion: 2.1 time: 0.148643 Jul 25 06:02:48.825744 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 343/674] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:48 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1657 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:48.841178 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9a0440e8-5d8f-467f-83bd-42c4739f2eba tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:48.847422 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9a0440e8-5d8f-467f-83bd-42c4739f2eba tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:48.847869 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9a0440e8-5d8f-467f-83bd-42c4739f2eba tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:48.908077 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-9a0440e8-5d8f-467f-83bd-42c4739f2eba tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Going to try to start instance {{(pid=130163) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 06:02:49.075249 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=2 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:49.109907 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9a0440e8-5d8f-467f-83bd-42c4739f2eba tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "POST /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/action" status: 202 len: 0 microversion: 2.1 time: 0.272060 Jul 25 06:02:49.110531 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 344/675] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 06:02:48 2022] POST /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 06:02:49.115458 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b93c7364-5e0d-4065-83bb-9f106f296423 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:49.116245 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b93c7364-5e0d-4065-83bb-9f106f296423 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:49.122580 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b93c7364-5e0d-4065-83bb-9f106f296423 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:49.123031 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b93c7364-5e0d-4065-83bb-9f106f296423 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:49.123822 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b93c7364-5e0d-4065-83bb-9f106f296423 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:49.124261 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b93c7364-5e0d-4065-83bb-9f106f296423 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:49.250084 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b93c7364-5e0d-4065-83bb-9f106f296423 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:49.258015 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b93c7364-5e0d-4065-83bb-9f106f296423 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1680 microversion: 2.1 time: 0.146395 Jul 25 06:02:49.258611 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 345/676] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:49 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:49.262937 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-393288e1-0395-4305-adcb-192acafe96c1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:49.263548 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-393288e1-0395-4305-adcb-192acafe96c1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:49.269764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-393288e1-0395-4305-adcb-192acafe96c1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:49.270217 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-393288e1-0395-4305-adcb-192acafe96c1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:49.271010 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-393288e1-0395-4305-adcb-192acafe96c1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:49.271448 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-393288e1-0395-4305-adcb-192acafe96c1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:49.378486 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=8 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:49.400185 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-393288e1-0395-4305-adcb-192acafe96c1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:49.407669 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-393288e1-0395-4305-adcb-192acafe96c1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1666 microversion: 2.1 time: 0.148094 Jul 25 06:02:49.408235 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 346/677] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:49 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1666 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:49.494789 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e5b772da-5415-44aa-86b4-c1e4d7b76d64 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:49.495397 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e5b772da-5415-44aa-86b4-c1e4d7b76d64 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:49.502264 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e5b772da-5415-44aa-86b4-c1e4d7b76d64 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:49.502774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e5b772da-5415-44aa-86b4-c1e4d7b76d64 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:49.503532 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e5b772da-5415-44aa-86b4-c1e4d7b76d64 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:49.504030 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e5b772da-5415-44aa-86b4-c1e4d7b76d64 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:49.633870 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e5b772da-5415-44aa-86b4-c1e4d7b76d64 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:49.641191 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e5b772da-5415-44aa-86b4-c1e4d7b76d64 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1315 microversion: 2.1 time: 0.150542 Jul 25 06:02:49.641749 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 347/678] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:49 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:50.275463 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-850a3c35-39f7-400d-b99e-1e56f57f6663 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:50.276100 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-850a3c35-39f7-400d-b99e-1e56f57f6663 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:50.281947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-850a3c35-39f7-400d-b99e-1e56f57f6663 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:50.282413 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-850a3c35-39f7-400d-b99e-1e56f57f6663 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:50.290824 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-850a3c35-39f7-400d-b99e-1e56f57f6663 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:50.290824 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-850a3c35-39f7-400d-b99e-1e56f57f6663 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:50.411827 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-850a3c35-39f7-400d-b99e-1e56f57f6663 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:50.419713 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-850a3c35-39f7-400d-b99e-1e56f57f6663 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1680 microversion: 2.1 time: 0.148062 Jul 25 06:02:50.420250 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 348/679] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:50 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:50.425380 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-429d43b1-1bb3-4558-8a70-2fc1b89da331 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:50.425978 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-429d43b1-1bb3-4558-8a70-2fc1b89da331 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:50.431576 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-429d43b1-1bb3-4558-8a70-2fc1b89da331 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:50.432013 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-429d43b1-1bb3-4558-8a70-2fc1b89da331 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:50.432809 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-429d43b1-1bb3-4558-8a70-2fc1b89da331 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:50.433238 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-429d43b1-1bb3-4558-8a70-2fc1b89da331 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:50.566425 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-429d43b1-1bb3-4558-8a70-2fc1b89da331 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:50.574180 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-429d43b1-1bb3-4558-8a70-2fc1b89da331 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1666 microversion: 2.1 time: 0.152948 Jul 25 06:02:50.574764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 349/680] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:50 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1666 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:50.658140 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-0acda490-879b-4bfc-92f8-358609caaac2 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:50.659394 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-0acda490-879b-4bfc-92f8-358609caaac2 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:50.666075 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0acda490-879b-4bfc-92f8-358609caaac2 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:50.666604 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0acda490-879b-4bfc-92f8-358609caaac2 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:50.667355 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0acda490-879b-4bfc-92f8-358609caaac2 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:50.667953 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0acda490-879b-4bfc-92f8-358609caaac2 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:50.688254 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:50.796451 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-0acda490-879b-4bfc-92f8-358609caaac2 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:50.805215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-0acda490-879b-4bfc-92f8-358609caaac2 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1315 microversion: 2.1 time: 0.151942 Jul 25 06:02:50.805792 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 350/681] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:50 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:51.438674 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-047198e6-5e86-4f96-960a-f5575ef23130 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:51.439357 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-047198e6-5e86-4f96-960a-f5575ef23130 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:51.454054 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-047198e6-5e86-4f96-960a-f5575ef23130 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:51.454646 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-047198e6-5e86-4f96-960a-f5575ef23130 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:51.455598 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-047198e6-5e86-4f96-960a-f5575ef23130 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:51.456644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-047198e6-5e86-4f96-960a-f5575ef23130 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:51.611184 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-047198e6-5e86-4f96-960a-f5575ef23130 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:51.618634 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-047198e6-5e86-4f96-960a-f5575ef23130 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1680 microversion: 2.1 time: 0.185032 Jul 25 06:02:51.619209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 351/682] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:51 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:51.625038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ec1fe729-8586-4576-9940-c8acaed58b98 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:51.625651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ec1fe729-8586-4576-9940-c8acaed58b98 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:51.632245 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ec1fe729-8586-4576-9940-c8acaed58b98 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:51.632700 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ec1fe729-8586-4576-9940-c8acaed58b98 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:51.633818 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ec1fe729-8586-4576-9940-c8acaed58b98 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:51.634254 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ec1fe729-8586-4576-9940-c8acaed58b98 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:51.875878 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ec1fe729-8586-4576-9940-c8acaed58b98 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:51.889167 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ec1fe729-8586-4576-9940-c8acaed58b98 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1666 microversion: 2.1 time: 0.267589 Jul 25 06:02:51.889641 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 352/683] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:51 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1666 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:51.903959 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-aa850ab3-ba7d-47c7-9f5d-6e0189e23a2b tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:51.905167 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-aa850ab3-ba7d-47c7-9f5d-6e0189e23a2b tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:51.913740 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aa850ab3-ba7d-47c7-9f5d-6e0189e23a2b tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:51.914269 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aa850ab3-ba7d-47c7-9f5d-6e0189e23a2b tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:51.915338 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aa850ab3-ba7d-47c7-9f5d-6e0189e23a2b tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:51.915773 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aa850ab3-ba7d-47c7-9f5d-6e0189e23a2b tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:52.128551 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-307f7343-a31d-40cd-a18a-a4ec71c92049 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "POST /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.844795 Jul 25 06:02:52.129340 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 332/684] 10.222.0.17 () {60 vars in 1322 bytes} [Mon Jul 25 06:02:48 2022] POST /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/os-volume_attachments => generated 194 bytes in 3847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:52.139069 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-aa850ab3-ba7d-47c7-9f5d-6e0189e23a2b tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:52.149622 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-aa850ab3-ba7d-47c7-9f5d-6e0189e23a2b tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1315 microversion: 2.1 time: 0.249409 Jul 25 06:02:52.150549 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 353/685] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:51 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:52.637378 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3ac8c886-b798-421e-8f58-cea581e79574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:52.638339 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3ac8c886-b798-421e-8f58-cea581e79574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:52.645111 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3ac8c886-b798-421e-8f58-cea581e79574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:52.645559 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3ac8c886-b798-421e-8f58-cea581e79574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:52.646319 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3ac8c886-b798-421e-8f58-cea581e79574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:52.646777 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3ac8c886-b798-421e-8f58-cea581e79574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:52.711177 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3ac8c886-b798-421e-8f58-cea581e79574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:52.718710 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3ac8c886-b798-421e-8f58-cea581e79574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1612 microversion: 2.1 time: 0.086041 Jul 25 06:02:52.719279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 333/686] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:52 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1612 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:52.858575 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-9f569419-37c9-40d5-b456-f96d08091602 req-8ece26b6-d21b-4790-a778-f0744a1127d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479a7885-4c31-448b-8d0d-42049d47896f", "name": "network-vif-deleted", "tag": "70a76596-074b-4a73-b7c5-338b9b7a51d2"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:52.867519 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-9f569419-37c9-40d5-b456-f96d08091602 req-8ece26b6-d21b-4790-a778-f0744a1127d5 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:52.867957 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-9f569419-37c9-40d5-b456-f96d08091602 req-8ece26b6-d21b-4790-a778-f0744a1127d5 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:52.880078 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-9f569419-37c9-40d5-b456-f96d08091602 req-8ece26b6-d21b-4790-a778-f0744a1127d5 service nova] Creating event network-vif-deleted:70a76596-074b-4a73-b7c5-338b9b7a51d2 for instance 479a7885-4c31-448b-8d0d-42049d47896f on hv-cinder-85083 Jul 25 06:02:52.885448 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-9f569419-37c9-40d5-b456-f96d08091602 req-8ece26b6-d21b-4790-a778-f0744a1127d5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030519 Jul 25 06:02:52.886047 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 354/687] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:52.905703 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6065e9a6-d3a5-454d-9f19-357f6c3c24ee tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:52.907636 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-6065e9a6-d3a5-454d-9f19-357f6c3c24ee tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:52.914755 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6065e9a6-d3a5-454d-9f19-357f6c3c24ee tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:52.915321 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6065e9a6-d3a5-454d-9f19-357f6c3c24ee tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:52.916204 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6065e9a6-d3a5-454d-9f19-357f6c3c24ee tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:52.916913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6065e9a6-d3a5-454d-9f19-357f6c3c24ee tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:53.074983 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-6065e9a6-d3a5-454d-9f19-357f6c3c24ee tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:53.085368 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-6065e9a6-d3a5-454d-9f19-357f6c3c24ee tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1666 microversion: 2.1 time: 0.183950 Jul 25 06:02:53.086522 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 334/688] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:52 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1666 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:53.170898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9db88623-6c89-4d36-ad82-17c896935313 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:53.171887 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-9db88623-6c89-4d36-ad82-17c896935313 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:53.181631 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9db88623-6c89-4d36-ad82-17c896935313 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:53.182307 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9db88623-6c89-4d36-ad82-17c896935313 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:53.183526 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9db88623-6c89-4d36-ad82-17c896935313 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:53.184192 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9db88623-6c89-4d36-ad82-17c896935313 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:53.348500 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9db88623-6c89-4d36-ad82-17c896935313 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:53.355994 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9db88623-6c89-4d36-ad82-17c896935313 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1315 microversion: 2.1 time: 0.192435 Jul 25 06:02:53.362591 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 355/689] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:53 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:53.737513 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1e9e643f-aee8-499a-a57f-98a9e800ba96 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:53.738796 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1e9e643f-aee8-499a-a57f-98a9e800ba96 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:53.745352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1e9e643f-aee8-499a-a57f-98a9e800ba96 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:53.745803 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1e9e643f-aee8-499a-a57f-98a9e800ba96 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:53.746601 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1e9e643f-aee8-499a-a57f-98a9e800ba96 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:53.747037 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1e9e643f-aee8-499a-a57f-98a9e800ba96 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:53.780405 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1e9e643f-aee8-499a-a57f-98a9e800ba96 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:53.780850 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1e9e643f-aee8-499a-a57f-98a9e800ba96 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:53.781305 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-1e9e643f-aee8-499a-a57f-98a9e800ba96 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lazy-loading 'fault' on Instance uuid 479a7885-4c31-448b-8d0d-42049d47896f {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:02:53.823086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1e9e643f-aee8-499a-a57f-98a9e800ba96 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:53.830602 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1e9e643f-aee8-499a-a57f-98a9e800ba96 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 200 len: 1331 microversion: 2.1 time: 0.097598 Jul 25 06:02:53.833059 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 335/690] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:53 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:54.102542 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-117a5092-5d28-40ff-8ead-2ceab1dfbfa6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:54.103160 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-117a5092-5d28-40ff-8ead-2ceab1dfbfa6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:54.109683 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-117a5092-5d28-40ff-8ead-2ceab1dfbfa6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:54.110128 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-117a5092-5d28-40ff-8ead-2ceab1dfbfa6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:54.110951 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-117a5092-5d28-40ff-8ead-2ceab1dfbfa6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:54.111387 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-117a5092-5d28-40ff-8ead-2ceab1dfbfa6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:54.245377 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-117a5092-5d28-40ff-8ead-2ceab1dfbfa6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:54.252761 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-117a5092-5d28-40ff-8ead-2ceab1dfbfa6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1666 microversion: 2.1 time: 0.154241 Jul 25 06:02:54.253342 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 356/691] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:54 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1666 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:54.373117 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-c592b8c9-e337-42df-b85f-0dc7f98e9339 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:54.373731 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-c592b8c9-e337-42df-b85f-0dc7f98e9339 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:54.380256 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c592b8c9-e337-42df-b85f-0dc7f98e9339 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:54.380701 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c592b8c9-e337-42df-b85f-0dc7f98e9339 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:54.381462 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c592b8c9-e337-42df-b85f-0dc7f98e9339 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:54.381895 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c592b8c9-e337-42df-b85f-0dc7f98e9339 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:54.515283 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-c592b8c9-e337-42df-b85f-0dc7f98e9339 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:54.523257 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-c592b8c9-e337-42df-b85f-0dc7f98e9339 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1315 microversion: 2.1 time: 0.154096 Jul 25 06:02:54.523857 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 336/692] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:54 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:54.850986 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-955cb88c-b806-47d3-adc2-e378d5412340 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:54.851608 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-955cb88c-b806-47d3-adc2-e378d5412340 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:54.857786 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-955cb88c-b806-47d3-adc2-e378d5412340 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:54.861002 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-955cb88c-b806-47d3-adc2-e378d5412340 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:54.861002 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-955cb88c-b806-47d3-adc2-e378d5412340 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:54.861002 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-955cb88c-b806-47d3-adc2-e378d5412340 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:54.873205 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-955cb88c-b806-47d3-adc2-e378d5412340 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] HTTP exception thrown: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-955cb88c-b806-47d3-adc2-e378d5412340 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Request method failure captured: Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f HTTP/1.1 Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEaup3unl7LzCcXgiLIPWZjrIYFX_SDw7ELDXjOyj6m1AigSppJN7j_MZUlx8A8dXfMKGKjZXWqF1YnEL3IukuRzY_02IDqinPYsk5il0dKKd6-RpE31D5qPeu1-2vVhe6F2MsA703sX0YNFO-wEG6wXFh49_JEAsgi8VdOlbOfuBo Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:02:54.875110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:02:54.876497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_488e87a8233e4e69a07cd8efba37cad7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:02:54.876497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:02:54.876497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:02:54.876497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:02:54.876497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:02:54.876497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:02:54.876497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:02:54.876497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 6dc49525e3394668b4f1610c4badc144 Jul 25 06:02:54.876497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:02:54.876497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:02:54.876497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. Jul 25 06:02:54.876497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '479a7885-4c31-448b-8d0d-42049d47896f'} Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:02:54.877219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. Jul 25 06:02:54.879061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:02:54.880106 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-955cb88c-b806-47d3-adc2-e378d5412340 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Returning 404 to user: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:02:54.880106 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-955cb88c-b806-47d3-adc2-e378d5412340 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 404 len: 111 microversion: 2.1 time: 0.029459 Jul 25 06:02:54.880106 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 357/693] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:54 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:02:54.888585 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3b49c3c6-d542-4eac-aed5-8064920e5c5d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '.version_select at 0x7f9d3616b160>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:54.943454 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3b49c3c6-d542-4eac-aed5-8064920e5c5d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-256098023" status: 202 len: 0 microversion: 2.1 time: 0.060491 Jul 25 06:02:54.944044 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 337/694] 10.222.0.17 () {58 vars in 1217 bytes} [Mon Jul 25 06:02:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-256098023 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 06:02:55.269596 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ac5d308b-d5ce-4af3-a397-3c08a0b3d8b8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:55.270226 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ac5d308b-d5ce-4af3-a397-3c08a0b3d8b8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:55.276868 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ac5d308b-d5ce-4af3-a397-3c08a0b3d8b8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:55.277317 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ac5d308b-d5ce-4af3-a397-3c08a0b3d8b8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:55.278102 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ac5d308b-d5ce-4af3-a397-3c08a0b3d8b8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:55.278567 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ac5d308b-d5ce-4af3-a397-3c08a0b3d8b8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:55.335503 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a0d280ff-0c49-45d5-9dfd-d76aade154bd tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:55.336309 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a0d280ff-0c49-45d5-9dfd-d76aade154bd tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:55.343002 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a0d280ff-0c49-45d5-9dfd-d76aade154bd tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:55.348662 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a0d280ff-0c49-45d5-9dfd-d76aade154bd tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:55.348662 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a0d280ff-0c49-45d5-9dfd-d76aade154bd tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:55.348662 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a0d280ff-0c49-45d5-9dfd-d76aade154bd tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:55.447411 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-a0d280ff-0c49-45d5-9dfd-d76aade154bd tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lazy-loading 'services' on Instance uuid 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:02:55.530753 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ac5d308b-d5ce-4af3-a397-3c08a0b3d8b8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:55.539141 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ac5d308b-d5ce-4af3-a397-3c08a0b3d8b8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1666 microversion: 2.1 time: 0.273455 Jul 25 06:02:55.548837 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 358/695] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:55 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1666 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:55.553808 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-87e6edcc-801d-4d9f-9238-a8e5e812fa83 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:55.554677 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-87e6edcc-801d-4d9f-9238-a8e5e812fa83 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:55.562016 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-87e6edcc-801d-4d9f-9238-a8e5e812fa83 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:55.562133 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-87e6edcc-801d-4d9f-9238-a8e5e812fa83 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:55.563510 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-87e6edcc-801d-4d9f-9238-a8e5e812fa83 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:55.564203 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-87e6edcc-801d-4d9f-9238-a8e5e812fa83 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:55.632372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a0d280ff-0c49-45d5-9dfd-d76aade154bd tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "DELETE /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404/os-volume_attachments/0be040f1-2816-49d3-a534-a1ffe4b1efc5" status: 202 len: 0 microversion: 2.1 time: 0.301832 Jul 25 06:02:55.633133 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 338/696] 10.222.0.17 () {58 vars in 1415 bytes} [Mon Jul 25 06:02:55 2022] DELETE /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404/os-volume_attachments/0be040f1-2816-49d3-a534-a1ffe4b1efc5 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:02:55.736575 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-87e6edcc-801d-4d9f-9238-a8e5e812fa83 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:55.744640 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-87e6edcc-801d-4d9f-9238-a8e5e812fa83 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1315 microversion: 2.1 time: 0.194527 Jul 25 06:02:55.747572 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 359/697] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:55 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:55.955118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8ad09611-e4b9-47de-bb14-8f874151662d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Action: 'create', calling method: .version_select at 0x7f9d35f53ee0>, body: {"keypair": {"name": "tempest-keypair-590426257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfZQesy70H7945T5EOz/PEqRH2CF5uaBEvbw5i9mCP7PUAJW9X6H5FtKMLnGHxw8+xcQl9H3QNA8zgWexSNVif6JUdZOIo/tXe0fa2eKTlQTPeXvZ/ExasYEoudZFTNUA=="}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:55.970336 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-8ad09611-e4b9-47de-bb14-8f874151662d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Getting quotas for project 488e87a8233e4e69a07cd8efba37cad7. Resources: {'key_pairs'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:02:55.974367 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-8ad09611-e4b9-47de-bb14-8f874151662d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Getting quotas for user 6dc49525e3394668b4f1610c4badc144 and project 488e87a8233e4e69a07cd8efba37cad7. Resources: {'key_pairs'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:02:56.063024 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-8ad09611-e4b9-47de-bb14-8f874151662d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.112629 Jul 25 06:02:56.064021 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 339/698] 10.222.0.17 () {60 vars in 1158 bytes} [Mon Jul 25 06:02:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:56.556778 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6e7cfe29-e840-4dd1-b211-d29b4021ec47 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:56.557398 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6e7cfe29-e840-4dd1-b211-d29b4021ec47 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:56.563823 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6e7cfe29-e840-4dd1-b211-d29b4021ec47 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.564272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6e7cfe29-e840-4dd1-b211-d29b4021ec47 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.565040 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6e7cfe29-e840-4dd1-b211-d29b4021ec47 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.566145 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6e7cfe29-e840-4dd1-b211-d29b4021ec47 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.714223 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6e7cfe29-e840-4dd1-b211-d29b4021ec47 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:56.735614 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6e7cfe29-e840-4dd1-b211-d29b4021ec47 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1670 microversion: 2.1 time: 0.170950 Jul 25 06:02:56.735614 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 360/699] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:56 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1670 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:56.761308 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-7dd2271d-707f-4c04-99ed-659bd08e8b5e tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:56.762373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-7dd2271d-707f-4c04-99ed-659bd08e8b5e tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:56.769125 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7dd2271d-707f-4c04-99ed-659bd08e8b5e tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.769581 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7dd2271d-707f-4c04-99ed-659bd08e8b5e tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.770351 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7dd2271d-707f-4c04-99ed-659bd08e8b5e tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.770814 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7dd2271d-707f-4c04-99ed-659bd08e8b5e tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.903923 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-7dd2271d-707f-4c04-99ed-659bd08e8b5e tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:56.912138 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-7dd2271d-707f-4c04-99ed-659bd08e8b5e tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1315 microversion: 2.1 time: 0.154891 Jul 25 06:02:56.912697 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 340/700] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:56 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:57.622539 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-651ad108-8e79-4a35-8f64-225243dbbe87 req-df913a02-f86a-44d9-80f7-24a9cb959963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "507ef3a5-7e3d-4526-af62-3cb140646d2d", "name": "network-vif-plugged", "status": "completed", "tag": "6954bd34-b5f3-4680-80af-8ff2ba489e07"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:57.633132 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-651ad108-8e79-4a35-8f64-225243dbbe87 req-df913a02-f86a-44d9-80f7-24a9cb959963 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:57.633835 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-651ad108-8e79-4a35-8f64-225243dbbe87 req-df913a02-f86a-44d9-80f7-24a9cb959963 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:57.648390 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-651ad108-8e79-4a35-8f64-225243dbbe87 req-df913a02-f86a-44d9-80f7-24a9cb959963 service nova] Creating event network-vif-plugged:6954bd34-b5f3-4680-80af-8ff2ba489e07 for instance 507ef3a5-7e3d-4526-af62-3cb140646d2d on hv-cinder-85083 Jul 25 06:02:57.653570 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-651ad108-8e79-4a35-8f64-225243dbbe87 req-df913a02-f86a-44d9-80f7-24a9cb959963 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036609 Jul 25 06:02:57.654590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 361/701] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:57.929917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-03eb6780-66dd-4db7-b30c-542a6d2e47fe tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:57.930552 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-03eb6780-66dd-4db7-b30c-542a6d2e47fe tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:57.937154 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-03eb6780-66dd-4db7-b30c-542a6d2e47fe tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:57.937857 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-03eb6780-66dd-4db7-b30c-542a6d2e47fe tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:57.938684 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-03eb6780-66dd-4db7-b30c-542a6d2e47fe tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:57.939120 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-03eb6780-66dd-4db7-b30c-542a6d2e47fe tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:58.103395 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-03eb6780-66dd-4db7-b30c-542a6d2e47fe tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:58.111087 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-03eb6780-66dd-4db7-b30c-542a6d2e47fe tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1315 microversion: 2.1 time: 0.185094 Jul 25 06:02:58.111681 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 341/702] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:57 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:58.551234 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a9ddf5ea-7388-4c6a-a921-2b3f1c6a3875 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1243822094", "imageRef": "bfffd6ef-7f99-4a99-90f3-027fe9c89821", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "805986bf-e25e-49a6-a0be-02e60deb2a2d"}], "security_groups": [{"name": "tempest-securitygroup--685220320"}], "key_name": "tempest-keypair-590426257", "user_data": "}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:58.654839 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.network.neutron [None req-a9ddf5ea-7388-4c6a-a921-2b3f1c6a3875 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] validate_networks() for [('805986bf-e25e-49a6-a0be-02e60deb2a2d', None, None, None, None, None)] {{(pid=130163) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:02:59.019171 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-a9ddf5ea-7388-4c6a-a921-2b3f1c6a3875 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Flavor limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:02:59.019587 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-a9ddf5ea-7388-4c6a-a921-2b3f1c6a3875 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Image limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:02:59.020065 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-a9ddf5ea-7388-4c6a-a921-2b3f1c6a3875 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Flavor pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:02:59.020501 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-a9ddf5ea-7388-4c6a-a921-2b3f1c6a3875 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Image pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:02:59.020917 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-a9ddf5ea-7388-4c6a-a921-2b3f1c6a3875 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:02:59.029598 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a9ddf5ea-7388-4c6a-a921-2b3f1c6a3875 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:59.030042 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a9ddf5ea-7388-4c6a-a921-2b3f1c6a3875 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:59.030882 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a9ddf5ea-7388-4c6a-a921-2b3f1c6a3875 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:59.031317 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a9ddf5ea-7388-4c6a-a921-2b3f1c6a3875 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:59.047842 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-a9ddf5ea-7388-4c6a-a921-2b3f1c6a3875 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Getting quotas for project 488e87a8233e4e69a07cd8efba37cad7. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:02:59.051763 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-a9ddf5ea-7388-4c6a-a921-2b3f1c6a3875 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Getting quotas for user 6dc49525e3394668b4f1610c4badc144 and project 488e87a8233e4e69a07cd8efba37cad7. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:02:59.062589 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a9ddf5ea-7388-4c6a-a921-2b3f1c6a3875 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Going to run 1 instances... {{(pid=130163) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:02:59.064969 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a9ddf5ea-7388-4c6a-a921-2b3f1c6a3875 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfffd6ef-7f99-4a99-90f3-027fe9c89821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:02:59.129092 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-dcb2f37f-a25f-4023-aa78-5dd18222af00 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:59.129713 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-dcb2f37f-a25f-4023-aa78-5dd18222af00 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:59.136169 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dcb2f37f-a25f-4023-aa78-5dd18222af00 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:59.136621 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dcb2f37f-a25f-4023-aa78-5dd18222af00 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:59.137434 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dcb2f37f-a25f-4023-aa78-5dd18222af00 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:59.137870 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dcb2f37f-a25f-4023-aa78-5dd18222af00 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:59.229007 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a9ddf5ea-7388-4c6a-a921-2b3f1c6a3875 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.682344 Jul 25 06:02:59.230217 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 362/703] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 06:02:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:02:59.240808 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d6253ac7-92d1-47f1-986b-d8d0338b53b1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:59.241862 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d6253ac7-92d1-47f1-986b-d8d0338b53b1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:59.270289 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-dcb2f37f-a25f-4023-aa78-5dd18222af00 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:59.278259 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-dcb2f37f-a25f-4023-aa78-5dd18222af00 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1315 microversion: 2.1 time: 0.153442 Jul 25 06:02:59.278873 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 342/704] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:59 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:59.298715 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d6253ac7-92d1-47f1-986b-d8d0338b53b1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:59.306514 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d6253ac7-92d1-47f1-986b-d8d0338b53b1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1241 microversion: 2.1 time: 0.070337 Jul 25 06:02:59.307282 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 363/705] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:59 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:00.294605 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-60654499-e95e-4ba0-93e1-e3f73b8175a5 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:00.295221 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-60654499-e95e-4ba0-93e1-e3f73b8175a5 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:00.301775 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-60654499-e95e-4ba0-93e1-e3f73b8175a5 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:00.302216 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-60654499-e95e-4ba0-93e1-e3f73b8175a5 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:00.302993 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-60654499-e95e-4ba0-93e1-e3f73b8175a5 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:00.303455 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-60654499-e95e-4ba0-93e1-e3f73b8175a5 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:00.324300 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-83bc78a0-91ff-46aa-8760-80f70f097353 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:00.324917 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-83bc78a0-91ff-46aa-8760-80f70f097353 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:00.327347 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:00.333159 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-83bc78a0-91ff-46aa-8760-80f70f097353 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:00.333698 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-83bc78a0-91ff-46aa-8760-80f70f097353 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:00.334433 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-83bc78a0-91ff-46aa-8760-80f70f097353 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:00.334897 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-83bc78a0-91ff-46aa-8760-80f70f097353 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:00.398207 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-83bc78a0-91ff-46aa-8760-80f70f097353 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:00.405599 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-83bc78a0-91ff-46aa-8760-80f70f097353 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1245 microversion: 2.1 time: 0.085152 Jul 25 06:03:00.406161 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 364/706] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:00 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:00.442755 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-60654499-e95e-4ba0-93e1-e3f73b8175a5 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:00.450176 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-60654499-e95e-4ba0-93e1-e3f73b8175a5 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1464 microversion: 2.1 time: 0.159503 Jul 25 06:03:00.450786 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 343/707] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:00 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:00.488353 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6e3d85fb-6dfa-4df9-a307-010c90619669 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:00.488877 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6e3d85fb-6dfa-4df9-a307-010c90619669 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:00.495427 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6e3d85fb-6dfa-4df9-a307-010c90619669 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:00.499989 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6e3d85fb-6dfa-4df9-a307-010c90619669 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:00.499989 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6e3d85fb-6dfa-4df9-a307-010c90619669 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:00.499989 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6e3d85fb-6dfa-4df9-a307-010c90619669 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:00.522454 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6e3d85fb-6dfa-4df9-a307-010c90619669 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Going to try to terminate instance {{(pid=130163) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:03:00.754200 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6e3d85fb-6dfa-4df9-a307-010c90619669 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "DELETE /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 204 len: 0 microversion: 2.1 time: 0.268562 Jul 25 06:03:00.754836 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 365/708] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:03:00 2022] DELETE /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:03:00.762786 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-76a4b267-6068-43c9-a4fc-cb7bdf74b93a tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:00.763495 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-76a4b267-6068-43c9-a4fc-cb7bdf74b93a tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:00.769772 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-76a4b267-6068-43c9-a4fc-cb7bdf74b93a tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:00.771063 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-76a4b267-6068-43c9-a4fc-cb7bdf74b93a tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:00.772306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-76a4b267-6068-43c9-a4fc-cb7bdf74b93a tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:00.772748 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-76a4b267-6068-43c9-a4fc-cb7bdf74b93a tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:00.907613 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-76a4b267-6068-43c9-a4fc-cb7bdf74b93a tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:00.916801 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-76a4b267-6068-43c9-a4fc-cb7bdf74b93a tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1470 microversion: 2.1 time: 0.156868 Jul 25 06:03:00.916801 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 344/709] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:00 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:01.422528 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b73058bf-d816-4229-bb1a-f9e1001444fc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:01.423236 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b73058bf-d816-4229-bb1a-f9e1001444fc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:01.430238 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b73058bf-d816-4229-bb1a-f9e1001444fc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:01.430719 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b73058bf-d816-4229-bb1a-f9e1001444fc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:01.431513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b73058bf-d816-4229-bb1a-f9e1001444fc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:01.431946 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b73058bf-d816-4229-bb1a-f9e1001444fc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:01.493685 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b73058bf-d816-4229-bb1a-f9e1001444fc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:01.501112 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b73058bf-d816-4229-bb1a-f9e1001444fc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1237 microversion: 2.1 time: 0.082867 Jul 25 06:03:01.501676 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 366/710] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:01 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:01.933594 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f86baa2e-2bac-439d-9460-bf7a1ad14f54 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:01.934159 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f86baa2e-2bac-439d-9460-bf7a1ad14f54 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:01.940595 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f86baa2e-2bac-439d-9460-bf7a1ad14f54 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:01.941041 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f86baa2e-2bac-439d-9460-bf7a1ad14f54 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:01.941789 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f86baa2e-2bac-439d-9460-bf7a1ad14f54 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:01.942216 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f86baa2e-2bac-439d-9460-bf7a1ad14f54 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:02.068042 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-f86baa2e-2bac-439d-9460-bf7a1ad14f54 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:02.075339 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f86baa2e-2bac-439d-9460-bf7a1ad14f54 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1470 microversion: 2.1 time: 0.145655 Jul 25 06:03:02.075904 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 345/711] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:01 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1470 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:02.518429 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7e8175ff-5068-451d-bcff-9f4b646bbbff tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:02.519096 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7e8175ff-5068-451d-bcff-9f4b646bbbff tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:02.525477 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7e8175ff-5068-451d-bcff-9f4b646bbbff tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:02.525917 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7e8175ff-5068-451d-bcff-9f4b646bbbff tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:02.526705 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7e8175ff-5068-451d-bcff-9f4b646bbbff tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:02.527136 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7e8175ff-5068-451d-bcff-9f4b646bbbff tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:02.590714 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7e8175ff-5068-451d-bcff-9f4b646bbbff tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:02.598629 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-7e8175ff-5068-451d-bcff-9f4b646bbbff tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1293 microversion: 2.1 time: 0.084090 Jul 25 06:03:02.599186 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 367/712] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:02 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:03.092186 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-baf65ff4-d8fd-4b24-af80-a1b70a18c9ff tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:03.092831 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-baf65ff4-d8fd-4b24-af80-a1b70a18c9ff tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:03.100409 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-baf65ff4-d8fd-4b24-af80-a1b70a18c9ff tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:03.100847 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-baf65ff4-d8fd-4b24-af80-a1b70a18c9ff tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:03.101598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-baf65ff4-d8fd-4b24-af80-a1b70a18c9ff tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:03.102024 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-baf65ff4-d8fd-4b24-af80-a1b70a18c9ff tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:03.233939 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-baf65ff4-d8fd-4b24-af80-a1b70a18c9ff tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:03.241329 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-baf65ff4-d8fd-4b24-af80-a1b70a18c9ff tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1470 microversion: 2.1 time: 0.153000 Jul 25 06:03:03.241886 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 346/713] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:03 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:03.615224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-952d17af-b995-45e4-b32b-77988ac7b1da tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:03.615852 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-952d17af-b995-45e4-b32b-77988ac7b1da tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:03.622189 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-952d17af-b995-45e4-b32b-77988ac7b1da tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:03.622756 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-952d17af-b995-45e4-b32b-77988ac7b1da tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:03.623550 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-952d17af-b995-45e4-b32b-77988ac7b1da tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:03.623982 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-952d17af-b995-45e4-b32b-77988ac7b1da tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:03.695121 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-952d17af-b995-45e4-b32b-77988ac7b1da tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:03.702634 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-952d17af-b995-45e4-b32b-77988ac7b1da tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1293 microversion: 2.1 time: 0.091234 Jul 25 06:03:03.703203 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 368/714] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:03 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:03.902502 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-789f8bab-b1ee-448c-a846-79aae5bc2013 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:03.903833 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-789f8bab-b1ee-448c-a846-79aae5bc2013 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:03.910419 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-789f8bab-b1ee-448c-a846-79aae5bc2013 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:03.913767 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-789f8bab-b1ee-448c-a846-79aae5bc2013 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:03.913767 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-789f8bab-b1ee-448c-a846-79aae5bc2013 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:03.913767 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-789f8bab-b1ee-448c-a846-79aae5bc2013 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:03.939067 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-789f8bab-b1ee-448c-a846-79aae5bc2013 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lazy-loading 'flavor' on Instance uuid d7bc67af-311c-4441-bd3e-96e8387de26e {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:03:04.107797 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:04.165799 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-c4c8b107-b7b2-4fdf-aa45-5326dd87b199 req-0d1bbd2a-142a-44c4-af09-48f0b884d284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "507ef3a5-7e3d-4526-af62-3cb140646d2d", "name": "network-vif-deleted", "tag": "6954bd34-b5f3-4680-80af-8ff2ba489e07"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:04.175802 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-c4c8b107-b7b2-4fdf-aa45-5326dd87b199 req-0d1bbd2a-142a-44c4-af09-48f0b884d284 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.176546 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-c4c8b107-b7b2-4fdf-aa45-5326dd87b199 req-0d1bbd2a-142a-44c4-af09-48f0b884d284 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.182045 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:04.189939 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-c4c8b107-b7b2-4fdf-aa45-5326dd87b199 req-0d1bbd2a-142a-44c4-af09-48f0b884d284 service nova] Creating event network-vif-deleted:6954bd34-b5f3-4680-80af-8ff2ba489e07 for instance 507ef3a5-7e3d-4526-af62-3cb140646d2d on hv-cinder-85083 Jul 25 06:03:04.195806 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-c4c8b107-b7b2-4fdf-aa45-5326dd87b199 req-0d1bbd2a-142a-44c4-af09-48f0b884d284 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034052 Jul 25 06:03:04.202010 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 369/715] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:03:04.261871 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d4c3c54b-ae1c-43f9-bd0c-30c47e880cb9 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:04.262611 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d4c3c54b-ae1c-43f9-bd0c-30c47e880cb9 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:04.271511 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d4c3c54b-ae1c-43f9-bd0c-30c47e880cb9 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.272238 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d4c3c54b-ae1c-43f9-bd0c-30c47e880cb9 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.273022 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d4c3c54b-ae1c-43f9-bd0c-30c47e880cb9 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.273635 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d4c3c54b-ae1c-43f9-bd0c-30c47e880cb9 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.340437 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-789f8bab-b1ee-448c-a846-79aae5bc2013 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "POST /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/action" status: 200 len: 32 microversion: 2.1 time: 0.444439 Jul 25 06:03:04.343295 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 347/716] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 06:03:03 2022] POST /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/action => generated 32 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 06:03:04.351629 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b42947a9-ff0f-4400-ab99-dc584c22366d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:04.353370 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b42947a9-ff0f-4400-ab99-dc584c22366d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:04.358049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d4c3c54b-ae1c-43f9-bd0c-30c47e880cb9 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e574d24a714fc4a0a2877b63829f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfa024bb4a475e9f914d91f6d01a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:04.361824 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b42947a9-ff0f-4400-ab99-dc584c22366d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.363379 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b42947a9-ff0f-4400-ab99-dc584c22366d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.365145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b42947a9-ff0f-4400-ab99-dc584c22366d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.365778 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b42947a9-ff0f-4400-ab99-dc584c22366d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.372841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d4c3c54b-ae1c-43f9-bd0c-30c47e880cb9 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 200 len: 1428 microversion: 2.1 time: 0.113133 Jul 25 06:03:04.373253 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 370/717] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:04 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 1428 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:04.523615 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b42947a9-ff0f-4400-ab99-dc584c22366d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:04.555998 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b42947a9-ff0f-4400-ab99-dc584c22366d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.209186 Jul 25 06:03:04.556804 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 348/718] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:04 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:04.720488 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-1dff00c3-fd4f-4d50-a7a1-8d97c51ac24a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:04.721228 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-1dff00c3-fd4f-4d50-a7a1-8d97c51ac24a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:04.728887 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1dff00c3-fd4f-4d50-a7a1-8d97c51ac24a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.729411 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1dff00c3-fd4f-4d50-a7a1-8d97c51ac24a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.730191 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1dff00c3-fd4f-4d50-a7a1-8d97c51ac24a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.730669 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1dff00c3-fd4f-4d50-a7a1-8d97c51ac24a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.795114 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-1dff00c3-fd4f-4d50-a7a1-8d97c51ac24a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:04.802356 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-1dff00c3-fd4f-4d50-a7a1-8d97c51ac24a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1299 microversion: 2.1 time: 0.086047 Jul 25 06:03:04.802952 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 371/719] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:04 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:05.208010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8f8844c2-b6f0-4041-8fa4-c21024f2fa90 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:05.208546 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8f8844c2-b6f0-4041-8fa4-c21024f2fa90 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:05.216329 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8f8844c2-b6f0-4041-8fa4-c21024f2fa90 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.217028 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8f8844c2-b6f0-4041-8fa4-c21024f2fa90 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.217799 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8f8844c2-b6f0-4041-8fa4-c21024f2fa90 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.218225 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8f8844c2-b6f0-4041-8fa4-c21024f2fa90 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.245305 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8f8844c2-b6f0-4041-8fa4-c21024f2fa90 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Going to try to terminate instance {{(pid=130162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:03:05.388245 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c039ff3b-5e06-449b-9f1b-149e0bf89d91 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:05.388888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c039ff3b-5e06-449b-9f1b-149e0bf89d91 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] [instance: 507ef3a5-7e3d-4526-af62-3cb140646d2d] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:05.395735 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c039ff3b-5e06-449b-9f1b-149e0bf89d91 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.396184 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c039ff3b-5e06-449b-9f1b-149e0bf89d91 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.396946 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c039ff3b-5e06-449b-9f1b-149e0bf89d91 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.397376 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c039ff3b-5e06-449b-9f1b-149e0bf89d91 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.410536 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-c039ff3b-5e06-449b-9f1b-149e0bf89d91 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] HTTP exception thrown: Instance 507ef3a5-7e3d-4526-af62-3cb140646d2d could not be found. Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c039ff3b-5e06-449b-9f1b-149e0bf89d91 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Request method failure captured: Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d HTTP/1.1 Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jH89SuIvzc2FTgX9xW3Ximy1GEz-bw2bRFnGg68nzfJzLBsvEl-5ZyXt3OHkhr5Zoj-Z750HW1l1bZb_WPMMLvW7TNEl94P5H31R_ouKuRHYUCatenageu6tzm2N2f-ceNa4GXTOGX1rIyPXE6Ur4Kz10CMlTLOxAbOlQU10HWsEKk Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 30bfa024bb4a475e9f914d91f6d01a8a Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-VolumesNegativeTest-1179314606 Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:03:05.412176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:03:05.415593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30bfa024bb4a475e9f914d91f6d01a8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30bfa024bb4a475e9f914d91f6d01a8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/30bfa024bb4a475e9f914d91f6d01a8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_30bfa024bb4a475e9f914d91f6d01a8a", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:03:05.415593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-VolumesNegativeTest-1179314606 Jul 25 06:03:05.415593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 30bfa024bb4a475e9f914d91f6d01a8a Jul 25 06:03:05.415593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-VolumesNegativeTest-1179314606 Jul 25 06:03:05.415593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-VolumesNegativeTest-1179314606-project Jul 25 06:03:05.415593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:03:05.415593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:03:05.415593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: a3e574d24a714fc4a0a2877b63829f26 Jul 25 06:03:05.415593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-VolumesNegativeTest-1179314606-project Jul 25 06:03:05.415593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:03:05.415593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 507ef3a5-7e3d-4526-af62-3cb140646d2d could not be found. Jul 25 06:03:05.415593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '507ef3a5-7e3d-4526-af62-3cb140646d2d'} Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 507ef3a5-7e3d-4526-af62-3cb140646d2d could not be found. Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:03:05.416385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 507ef3a5-7e3d-4526-af62-3cb140646d2d could not be found. Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 507ef3a5-7e3d-4526-af62-3cb140646d2d could not be found. Jul 25 06:03:05.417600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:03:05.418766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c039ff3b-5e06-449b-9f1b-149e0bf89d91 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] Returning 404 to user: Instance 507ef3a5-7e3d-4526-af62-3cb140646d2d could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:03:05.418766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c039ff3b-5e06-449b-9f1b-149e0bf89d91 tempest-VolumesNegativeTest-1179314606 tempest-VolumesNegativeTest-1179314606-project] 10.222.0.17 "GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d" status: 404 len: 111 microversion: 2.1 time: 0.029319 Jul 25 06:03:05.418766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 372/720] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:05 2022] GET /compute/v2.1/servers/507ef3a5-7e3d-4526-af62-3cb140646d2d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 06:03:05.530976 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-8f8844c2-b6f0-4041-8fa4-c21024f2fa90 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "DELETE /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 204 len: 0 microversion: 2.1 time: 0.327244 Jul 25 06:03:05.532009 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 349/721] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:03:05 2022] DELETE /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:03:05.542292 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2e6fcbb3-fca3-4814-a129-c634a63003e7 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:05.543002 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2e6fcbb3-fca3-4814-a129-c634a63003e7 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:05.550778 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2e6fcbb3-fca3-4814-a129-c634a63003e7 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.551313 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2e6fcbb3-fca3-4814-a129-c634a63003e7 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.552422 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2e6fcbb3-fca3-4814-a129-c634a63003e7 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.552864 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2e6fcbb3-fca3-4814-a129-c634a63003e7 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.574364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-066055d0-4081-4f8f-a799-d107186e20d6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:05.575181 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-066055d0-4081-4f8f-a799-d107186e20d6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:05.587430 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-066055d0-4081-4f8f-a799-d107186e20d6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.587827 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-066055d0-4081-4f8f-a799-d107186e20d6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.588604 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-066055d0-4081-4f8f-a799-d107186e20d6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.589036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-066055d0-4081-4f8f-a799-d107186e20d6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.777977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-066055d0-4081-4f8f-a799-d107186e20d6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:05.790412 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-066055d0-4081-4f8f-a799-d107186e20d6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.220619 Jul 25 06:03:05.791080 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 350/722] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:05 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:05.792449 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2e6fcbb3-fca3-4814-a129-c634a63003e7 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:05.802602 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2e6fcbb3-fca3-4814-a129-c634a63003e7 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1514 microversion: 2.1 time: 0.265079 Jul 25 06:03:05.806514 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 373/723] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:05 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1514 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:05.820647 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-79e8cf65-890a-47ba-9913-68ddc1c65018 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:05.821269 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-79e8cf65-890a-47ba-9913-68ddc1c65018 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:05.827348 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-79e8cf65-890a-47ba-9913-68ddc1c65018 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.828115 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-79e8cf65-890a-47ba-9913-68ddc1c65018 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.828887 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-79e8cf65-890a-47ba-9913-68ddc1c65018 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.829323 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-79e8cf65-890a-47ba-9913-68ddc1c65018 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.934599 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-afb81394-0098-443b-8fdd-9c0c963473e9 req-160bb173-0111-4348-b102-00d85c3310c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a277f58b-99c2-4b07-a838-9f45f9009f92", "tag": "fa9ad9cc-f41d-4f22-aff2-361b56dc3035"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:05.952379 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-afb81394-0098-443b-8fdd-9c0c963473e9 req-160bb173-0111-4348-b102-00d85c3310c4 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.952836 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-afb81394-0098-443b-8fdd-9c0c963473e9 req-160bb173-0111-4348-b102-00d85c3310c4 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.969100 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-afb81394-0098-443b-8fdd-9c0c963473e9 req-160bb173-0111-4348-b102-00d85c3310c4 service nova] Creating event network-changed:fa9ad9cc-f41d-4f22-aff2-361b56dc3035 for instance a277f58b-99c2-4b07-a838-9f45f9009f92 on hv-cinder-85083 Jul 25 06:03:05.974863 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-afb81394-0098-443b-8fdd-9c0c963473e9 req-160bb173-0111-4348-b102-00d85c3310c4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045771 Jul 25 06:03:05.975478 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 374/724] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:05.984005 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=4 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:06.005140 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-79e8cf65-890a-47ba-9913-68ddc1c65018 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:06.012689 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-79e8cf65-890a-47ba-9913-68ddc1c65018 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1366 microversion: 2.1 time: 0.196947 Jul 25 06:03:06.013266 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 351/725] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:05 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:06.809981 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ca3ba298-2e4d-4e42-8378-404c8c21bcf5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:06.810617 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ca3ba298-2e4d-4e42-8378-404c8c21bcf5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:06.817856 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ca3ba298-2e4d-4e42-8378-404c8c21bcf5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:06.818312 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ca3ba298-2e4d-4e42-8378-404c8c21bcf5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:06.819822 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ca3ba298-2e4d-4e42-8378-404c8c21bcf5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:06.820269 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ca3ba298-2e4d-4e42-8378-404c8c21bcf5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:06.821349 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-01cb0e1c-ca1e-43ea-9d27-05d3b43d93d3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:06.821961 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-01cb0e1c-ca1e-43ea-9d27-05d3b43d93d3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:06.829228 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-01cb0e1c-ca1e-43ea-9d27-05d3b43d93d3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:06.832372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-01cb0e1c-ca1e-43ea-9d27-05d3b43d93d3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:06.832372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-01cb0e1c-ca1e-43ea-9d27-05d3b43d93d3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:06.832372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-01cb0e1c-ca1e-43ea-9d27-05d3b43d93d3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:06.977903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ca3ba298-2e4d-4e42-8378-404c8c21bcf5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:06.987905 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-01cb0e1c-ca1e-43ea-9d27-05d3b43d93d3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:06.988074 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ca3ba298-2e4d-4e42-8378-404c8c21bcf5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.182713 Jul 25 06:03:06.990891 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 375/726] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:06 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:06.996739 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-01cb0e1c-ca1e-43ea-9d27-05d3b43d93d3 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1514 microversion: 2.1 time: 0.179169 Jul 25 06:03:06.998701 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 352/727] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:06 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:07.029386 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-feea13cb-ca97-4010-afc3-e45808b8aa02 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:07.030002 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-feea13cb-ca97-4010-afc3-e45808b8aa02 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:07.036683 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-feea13cb-ca97-4010-afc3-e45808b8aa02 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:07.037135 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-feea13cb-ca97-4010-afc3-e45808b8aa02 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:07.037896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-feea13cb-ca97-4010-afc3-e45808b8aa02 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:07.038334 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-feea13cb-ca97-4010-afc3-e45808b8aa02 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:07.167203 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-feea13cb-ca97-4010-afc3-e45808b8aa02 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:07.174693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-feea13cb-ca97-4010-afc3-e45808b8aa02 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1366 microversion: 2.1 time: 0.149048 Jul 25 06:03:07.177070 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 376/728] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:07 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:08.005365 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-7c782445-e29a-4e1a-b3ae-db701ebb71b0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:08.006150 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-7c782445-e29a-4e1a-b3ae-db701ebb71b0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:08.013871 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4ce10f6e-8260-41b1-ba7b-4e1d21e0bcef tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:08.015206 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4ce10f6e-8260-41b1-ba7b-4e1d21e0bcef tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:08.015743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7c782445-e29a-4e1a-b3ae-db701ebb71b0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:08.016371 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7c782445-e29a-4e1a-b3ae-db701ebb71b0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:08.017189 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7c782445-e29a-4e1a-b3ae-db701ebb71b0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:08.017634 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7c782445-e29a-4e1a-b3ae-db701ebb71b0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:08.023814 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4ce10f6e-8260-41b1-ba7b-4e1d21e0bcef tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:08.025152 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4ce10f6e-8260-41b1-ba7b-4e1d21e0bcef tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:08.026224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4ce10f6e-8260-41b1-ba7b-4e1d21e0bcef tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:08.026926 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4ce10f6e-8260-41b1-ba7b-4e1d21e0bcef tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:08.232705 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4ce10f6e-8260-41b1-ba7b-4e1d21e0bcef tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:08.262283 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4ce10f6e-8260-41b1-ba7b-4e1d21e0bcef tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1514 microversion: 2.1 time: 0.252474 Jul 25 06:03:08.263604 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 377/729] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:08 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1514 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:08.277540 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-bef70981-bffb-4824-b1d4-988728bf7d13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:08.278171 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-bef70981-bffb-4824-b1d4-988728bf7d13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:08.281935 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-7c782445-e29a-4e1a-b3ae-db701ebb71b0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:08.292286 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-7c782445-e29a-4e1a-b3ae-db701ebb71b0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.290972 Jul 25 06:03:08.302658 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 353/730] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:08 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:08.304004 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bef70981-bffb-4824-b1d4-988728bf7d13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:08.304901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bef70981-bffb-4824-b1d4-988728bf7d13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:08.305902 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bef70981-bffb-4824-b1d4-988728bf7d13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:08.306304 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-bef70981-bffb-4824-b1d4-988728bf7d13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:08.499385 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-53762d10-a329-496a-8057-afa3537fe742 req-694c4abb-be65-491b-8cff-c6ab4b9589a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404", "name": "network-vif-deleted", "tag": "b64f5129-42ac-424a-aa95-8c9a29c2d5dc"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:08.507949 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-53762d10-a329-496a-8057-afa3537fe742 req-694c4abb-be65-491b-8cff-c6ab4b9589a7 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:08.508393 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-53762d10-a329-496a-8057-afa3537fe742 req-694c4abb-be65-491b-8cff-c6ab4b9589a7 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:08.519666 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-53762d10-a329-496a-8057-afa3537fe742 req-694c4abb-be65-491b-8cff-c6ab4b9589a7 service nova] Creating event network-vif-deleted:b64f5129-42ac-424a-aa95-8c9a29c2d5dc for instance 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 on hv-cinder-85083 Jul 25 06:03:08.525222 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-53762d10-a329-496a-8057-afa3537fe742 req-694c4abb-be65-491b-8cff-c6ab4b9589a7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029495 Jul 25 06:03:08.525829 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 354/731] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:03:08.526538 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-bef70981-bffb-4824-b1d4-988728bf7d13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:08.535312 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-bef70981-bffb-4824-b1d4-988728bf7d13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1366 microversion: 2.1 time: 0.270078 Jul 25 06:03:08.536407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 378/732] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:08 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:09.280708 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f069c105-165f-4e5d-bcf9-660f73b0755c tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:09.281328 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f069c105-165f-4e5d-bcf9-660f73b0755c tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:09.288493 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f069c105-165f-4e5d-bcf9-660f73b0755c tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:09.288930 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f069c105-165f-4e5d-bcf9-660f73b0755c tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:09.289676 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f069c105-165f-4e5d-bcf9-660f73b0755c tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:09.290457 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f069c105-165f-4e5d-bcf9-660f73b0755c tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:09.311571 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4aaee88e-a7c7-4606-b203-1a75e62fadac tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:09.312123 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4aaee88e-a7c7-4606-b203-1a75e62fadac tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:09.314625 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=2 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:09.315330 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=8 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:09.320033 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4aaee88e-a7c7-4606-b203-1a75e62fadac tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:09.320485 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4aaee88e-a7c7-4606-b203-1a75e62fadac tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:09.321254 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4aaee88e-a7c7-4606-b203-1a75e62fadac tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:09.321693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4aaee88e-a7c7-4606-b203-1a75e62fadac tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:09.354171 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-f069c105-165f-4e5d-bcf9-660f73b0755c tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:09.361846 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f069c105-165f-4e5d-bcf9-660f73b0755c tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1472 microversion: 2.1 time: 0.085396 Jul 25 06:03:09.362420 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 355/733] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:09 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1472 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:09.464099 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4aaee88e-a7c7-4606-b203-1a75e62fadac tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:09.472365 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4aaee88e-a7c7-4606-b203-1a75e62fadac tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.164691 Jul 25 06:03:09.472972 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 379/734] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:09 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:09.553123 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-86c69d6f-efb8-44dc-b20f-9dc0a9911323 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:09.553959 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-86c69d6f-efb8-44dc-b20f-9dc0a9911323 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:09.559961 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-86c69d6f-efb8-44dc-b20f-9dc0a9911323 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:09.564573 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-86c69d6f-efb8-44dc-b20f-9dc0a9911323 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:09.564573 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-86c69d6f-efb8-44dc-b20f-9dc0a9911323 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:09.564573 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-86c69d6f-efb8-44dc-b20f-9dc0a9911323 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:09.704130 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-86c69d6f-efb8-44dc-b20f-9dc0a9911323 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:09.716608 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-86c69d6f-efb8-44dc-b20f-9dc0a9911323 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1366 microversion: 2.1 time: 0.168273 Jul 25 06:03:09.717334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 356/735] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:09 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:10.379505 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9be35a6b-5fca-4ae4-99f3-2433a0c6d001 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:10.380215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-9be35a6b-5fca-4ae4-99f3-2433a0c6d001 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:10.387362 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9be35a6b-5fca-4ae4-99f3-2433a0c6d001 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:10.387811 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9be35a6b-5fca-4ae4-99f3-2433a0c6d001 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:10.388573 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9be35a6b-5fca-4ae4-99f3-2433a0c6d001 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:10.389003 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9be35a6b-5fca-4ae4-99f3-2433a0c6d001 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:10.419232 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9be35a6b-5fca-4ae4-99f3-2433a0c6d001 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:10.419677 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9be35a6b-5fca-4ae4-99f3-2433a0c6d001 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:10.420123 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.objects.instance [None req-9be35a6b-5fca-4ae4-99f3-2433a0c6d001 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lazy-loading 'fault' on Instance uuid 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 {{(pid=130163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:03:10.461543 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9be35a6b-5fca-4ae4-99f3-2433a0c6d001 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99feeb6cf0fa46b4aabecefcdf56deff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f37a52ba6146e5b1cccfdba0c60a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:10.468467 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9be35a6b-5fca-4ae4-99f3-2433a0c6d001 tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 200 len: 1309 microversion: 2.1 time: 0.092833 Jul 25 06:03:10.469040 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 380/736] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:10 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:10.488812 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-85a10b92-1ff0-4859-b4ac-4d79cd9f2840 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:10.489427 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-85a10b92-1ff0-4859-b4ac-4d79cd9f2840 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:10.497040 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-85a10b92-1ff0-4859-b4ac-4d79cd9f2840 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:10.497484 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-85a10b92-1ff0-4859-b4ac-4d79cd9f2840 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:10.498244 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-85a10b92-1ff0-4859-b4ac-4d79cd9f2840 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:10.498706 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-85a10b92-1ff0-4859-b4ac-4d79cd9f2840 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:10.635157 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-85a10b92-1ff0-4859-b4ac-4d79cd9f2840 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:10.643078 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-85a10b92-1ff0-4859-b4ac-4d79cd9f2840 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.158041 Jul 25 06:03:10.643638 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 357/737] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:10 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:10.733282 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-100fba53-24a3-4231-8199-e5548b7d92c7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:10.733896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-100fba53-24a3-4231-8199-e5548b7d92c7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:10.740702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-100fba53-24a3-4231-8199-e5548b7d92c7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:10.741146 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-100fba53-24a3-4231-8199-e5548b7d92c7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:10.741899 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-100fba53-24a3-4231-8199-e5548b7d92c7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:10.742327 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-100fba53-24a3-4231-8199-e5548b7d92c7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:10.874196 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-100fba53-24a3-4231-8199-e5548b7d92c7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:10.880737 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-100fba53-24a3-4231-8199-e5548b7d92c7 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1366 microversion: 2.1 time: 0.151286 Jul 25 06:03:10.881241 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 381/738] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:10 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:11.485431 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-928c4dff-c672-408f-8b6f-c587b8724cbb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:11.486777 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-928c4dff-c672-408f-8b6f-c587b8724cbb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] [instance: 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:11.492824 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-928c4dff-c672-408f-8b6f-c587b8724cbb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:11.493418 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-928c4dff-c672-408f-8b6f-c587b8724cbb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:11.494059 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-928c4dff-c672-408f-8b6f-c587b8724cbb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:11.494519 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-928c4dff-c672-408f-8b6f-c587b8724cbb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:11.509134 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-928c4dff-c672-408f-8b6f-c587b8724cbb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] HTTP exception thrown: Instance 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 could not be found. Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-928c4dff-c672-408f-8b6f-c587b8724cbb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Request method failure captured: Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 HTTP/1.1 Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jF3XTd91ynaBAE-diOQaHdyc6_zgnArxLWfPPC4iYU2ZZRgBzDaHUASA6SKJPrp0DE-Yqbd6JF81anhoY8c5hk_6D8Zap4wEtujNfCzomkW3KVFcIplO23oxNNVoDZNGrlOxkBB07s8J8EuISzRFn5yriyWwLBvBB2gKN_4wXBUQVY Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: d9f37a52ba6146e5b1cccfdba0c60a18 Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1922150703 Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:03:11.513045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:03:11.514649 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9f37a52ba6146e5b1cccfdba0c60a18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d9f37a52ba6146e5b1cccfdba0c60a18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d9f37a52ba6146e5b1cccfdba0c60a18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d9f37a52ba6146e5b1cccfdba0c60a18", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:03:11.514649 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-VolumesSnapshotTestJSON-1922150703 Jul 25 06:03:11.514649 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: d9f37a52ba6146e5b1cccfdba0c60a18 Jul 25 06:03:11.514649 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1922150703 Jul 25 06:03:11.514649 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-VolumesSnapshotTestJSON-1922150703-project Jul 25 06:03:11.514649 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:03:11.514649 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:03:11.514649 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 99feeb6cf0fa46b4aabecefcdf56deff Jul 25 06:03:11.514649 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-VolumesSnapshotTestJSON-1922150703-project Jul 25 06:03:11.514649 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:03:11.514649 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 could not be found. Jul 25 06:03:11.514649 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404'} Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 could not be found. Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:03:11.515533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 could not be found. Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 could not be found. Jul 25 06:03:11.516830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:11.518275 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-928c4dff-c672-408f-8b6f-c587b8724cbb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] Returning 404 to user: Instance 537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:03:11.518275 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-928c4dff-c672-408f-8b6f-c587b8724cbb tempest-VolumesSnapshotTestJSON-1922150703 tempest-VolumesSnapshotTestJSON-1922150703-project] 10.222.0.17 "GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404" status: 404 len: 111 microversion: 2.1 time: 0.030920 Jul 25 06:03:11.518275 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 358/739] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:11 2022] GET /compute/v2.1/servers/537ab8bc-fb9e-4abe-a6ba-fd60dc8fc404 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:03:11.661099 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-aec566e7-73b7-4b9b-9ff8-359c70be91d8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:11.662731 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-aec566e7-73b7-4b9b-9ff8-359c70be91d8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:11.671003 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aec566e7-73b7-4b9b-9ff8-359c70be91d8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:11.671563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aec566e7-73b7-4b9b-9ff8-359c70be91d8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:11.674383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aec566e7-73b7-4b9b-9ff8-359c70be91d8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:11.674962 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aec566e7-73b7-4b9b-9ff8-359c70be91d8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:11.841933 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-aec566e7-73b7-4b9b-9ff8-359c70be91d8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:11.850203 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-aec566e7-73b7-4b9b-9ff8-359c70be91d8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.192893 Jul 25 06:03:11.851138 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 382/740] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:11 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:11.897405 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b89e6079-4e52-4fef-bd87-e1677ab9ef53 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:11.898136 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b89e6079-4e52-4fef-bd87-e1677ab9ef53 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:11.904556 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b89e6079-4e52-4fef-bd87-e1677ab9ef53 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:11.905006 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b89e6079-4e52-4fef-bd87-e1677ab9ef53 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:11.905779 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b89e6079-4e52-4fef-bd87-e1677ab9ef53 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:11.906217 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b89e6079-4e52-4fef-bd87-e1677ab9ef53 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:12.043994 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b89e6079-4e52-4fef-bd87-e1677ab9ef53 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:12.051593 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b89e6079-4e52-4fef-bd87-e1677ab9ef53 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1366 microversion: 2.1 time: 0.157960 Jul 25 06:03:12.062293 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 359/741] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:11 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:12.867651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c16bca39-92a0-402c-a6a0-f339cff6609e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:12.868257 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c16bca39-92a0-402c-a6a0-f339cff6609e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:12.874719 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c16bca39-92a0-402c-a6a0-f339cff6609e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:12.875161 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c16bca39-92a0-402c-a6a0-f339cff6609e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:12.875906 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c16bca39-92a0-402c-a6a0-f339cff6609e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:12.876378 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c16bca39-92a0-402c-a6a0-f339cff6609e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:13.019065 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-c16bca39-92a0-402c-a6a0-f339cff6609e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:13.027182 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c16bca39-92a0-402c-a6a0-f339cff6609e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.163951 Jul 25 06:03:13.027937 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 383/742] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:12 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:13.068898 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-705ee846-3d42-43dc-b4d8-c43bd8659f53 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:13.069513 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-705ee846-3d42-43dc-b4d8-c43bd8659f53 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:13.075962 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-705ee846-3d42-43dc-b4d8-c43bd8659f53 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:13.076411 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-705ee846-3d42-43dc-b4d8-c43bd8659f53 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:13.077175 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-705ee846-3d42-43dc-b4d8-c43bd8659f53 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:13.077611 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-705ee846-3d42-43dc-b4d8-c43bd8659f53 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:13.208580 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-705ee846-3d42-43dc-b4d8-c43bd8659f53 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:13.216498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-705ee846-3d42-43dc-b4d8-c43bd8659f53 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1366 microversion: 2.1 time: 0.151472 Jul 25 06:03:13.217094 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 360/743] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:13 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:13.666315 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-10010ef9-78ab-4883-8454-e2ce95f87b6c req-75c6f3ed-4cb9-4e77-8517-5d62ba16e241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a277f58b-99c2-4b07-a838-9f45f9009f92", "name": "network-vif-plugged", "status": "completed", "tag": "fa9ad9cc-f41d-4f22-aff2-361b56dc3035"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:13.674738 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-10010ef9-78ab-4883-8454-e2ce95f87b6c req-75c6f3ed-4cb9-4e77-8517-5d62ba16e241 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:13.675175 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-10010ef9-78ab-4883-8454-e2ce95f87b6c req-75c6f3ed-4cb9-4e77-8517-5d62ba16e241 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:13.687955 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-10010ef9-78ab-4883-8454-e2ce95f87b6c req-75c6f3ed-4cb9-4e77-8517-5d62ba16e241 service nova] Creating event network-vif-plugged:fa9ad9cc-f41d-4f22-aff2-361b56dc3035 for instance a277f58b-99c2-4b07-a838-9f45f9009f92 on hv-cinder-85083 Jul 25 06:03:13.693179 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-10010ef9-78ab-4883-8454-e2ce95f87b6c req-75c6f3ed-4cb9-4e77-8517-5d62ba16e241 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031878 Jul 25 06:03:13.697107 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 384/744] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:14.044531 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-59d2c0bf-4457-4ff7-a74d-c10f49e5f96a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:14.045393 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-59d2c0bf-4457-4ff7-a74d-c10f49e5f96a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:14.052021 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-59d2c0bf-4457-4ff7-a74d-c10f49e5f96a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.052472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-59d2c0bf-4457-4ff7-a74d-c10f49e5f96a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.053868 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-59d2c0bf-4457-4ff7-a74d-c10f49e5f96a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.054303 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-59d2c0bf-4457-4ff7-a74d-c10f49e5f96a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.185086 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c6386f37-4f09-4f85-b36f-4112666828aa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:14.185532 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-59d2c0bf-4457-4ff7-a74d-c10f49e5f96a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:14.185907 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c6386f37-4f09-4f85-b36f-4112666828aa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:14.192870 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c6386f37-4f09-4f85-b36f-4112666828aa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.193170 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-59d2c0bf-4457-4ff7-a74d-c10f49e5f96a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.152514 Jul 25 06:03:14.194856 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 361/745] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:14 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:14.195402 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c6386f37-4f09-4f85-b36f-4112666828aa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.196260 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c6386f37-4f09-4f85-b36f-4112666828aa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.196865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c6386f37-4f09-4f85-b36f-4112666828aa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.225860 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c6386f37-4f09-4f85-b36f-4112666828aa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-volume_attachments/1c877384-6d8c-451d-a3db-153ff78acced" status: 200 len: 194 microversion: 2.20 time: 0.045386 Jul 25 06:03:14.226434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 385/746] 10.222.0.17 () {60 vars in 1453 bytes} [Mon Jul 25 06:03:14 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-volume_attachments/1c877384-6d8c-451d-a3db-153ff78acced => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 06:03:14.233656 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-4a3a1851-0e54-48d8-8b97-c7e33d8c0566 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:14.233964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-4a3a1851-0e54-48d8-8b97-c7e33d8c0566 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:14.239960 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4a3a1851-0e54-48d8-8b97-c7e33d8c0566 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.241013 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4a3a1851-0e54-48d8-8b97-c7e33d8c0566 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.241768 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4a3a1851-0e54-48d8-8b97-c7e33d8c0566 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.242197 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4a3a1851-0e54-48d8-8b97-c7e33d8c0566 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.294505 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d911cfac-4467-44a6-8016-06b9c0a838f3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:14.295362 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d911cfac-4467-44a6-8016-06b9c0a838f3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:14.305187 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d911cfac-4467-44a6-8016-06b9c0a838f3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.305650 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d911cfac-4467-44a6-8016-06b9c0a838f3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.306447 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d911cfac-4467-44a6-8016-06b9c0a838f3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.306914 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d911cfac-4467-44a6-8016-06b9c0a838f3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.379614 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4a3a1851-0e54-48d8-8b97-c7e33d8c0566 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:14.387983 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-4a3a1851-0e54-48d8-8b97-c7e33d8c0566 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1366 microversion: 2.1 time: 0.158480 Jul 25 06:03:14.388624 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 362/747] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:14 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:14.389656 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.objects.instance [None req-d911cfac-4467-44a6-8016-06b9c0a838f3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lazy-loading 'services' on Instance uuid 348f256d-41e5-47d8-b165-cad6dfcd0be9 {{(pid=130163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:03:14.589749 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d911cfac-4467-44a6-8016-06b9c0a838f3 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "DELETE /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-volume_attachments/1c877384-6d8c-451d-a3db-153ff78acced" status: 202 len: 0 microversion: 2.20 time: 0.301563 Jul 25 06:03:14.590339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 386/748] 10.222.0.17 () {60 vars in 1456 bytes} [Mon Jul 25 06:03:14 2022] DELETE /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-volume_attachments/1c877384-6d8c-451d-a3db-153ff78acced => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 06:03:14.598828 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-fd46c46f-27ac-424f-b63f-ee04fa1880aa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:14.600286 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-fd46c46f-27ac-424f-b63f-ee04fa1880aa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:14.606248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fd46c46f-27ac-424f-b63f-ee04fa1880aa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.606728 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fd46c46f-27ac-424f-b63f-ee04fa1880aa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.607488 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fd46c46f-27ac-424f-b63f-ee04fa1880aa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.607921 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fd46c46f-27ac-424f-b63f-ee04fa1880aa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.611676 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:14.636844 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-fd46c46f-27ac-424f-b63f-ee04fa1880aa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042075 Jul 25 06:03:14.637391 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 363/749] 10.222.0.17 () {60 vars in 1342 bytes} [Mon Jul 25 06:03:14 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 06:03:15.211772 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-abb6ef09-b593-4a91-8b40-53a56eef9aa4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:15.212397 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-abb6ef09-b593-4a91-8b40-53a56eef9aa4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:15.218626 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-abb6ef09-b593-4a91-8b40-53a56eef9aa4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:15.219076 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-abb6ef09-b593-4a91-8b40-53a56eef9aa4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:15.219833 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-abb6ef09-b593-4a91-8b40-53a56eef9aa4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:15.220264 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-abb6ef09-b593-4a91-8b40-53a56eef9aa4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:15.237398 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:15.352335 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-abb6ef09-b593-4a91-8b40-53a56eef9aa4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:15.360237 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-abb6ef09-b593-4a91-8b40-53a56eef9aa4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.153210 Jul 25 06:03:15.360804 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 387/750] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:15 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:15.405331 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2ea7140d-a0bc-4742-b8c0-330b3d00d3e0 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:15.405942 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2ea7140d-a0bc-4742-b8c0-330b3d00d3e0 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:15.412732 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2ea7140d-a0bc-4742-b8c0-330b3d00d3e0 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:15.413175 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2ea7140d-a0bc-4742-b8c0-330b3d00d3e0 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:15.413928 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2ea7140d-a0bc-4742-b8c0-330b3d00d3e0 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:15.414366 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2ea7140d-a0bc-4742-b8c0-330b3d00d3e0 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:15.542487 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2ea7140d-a0bc-4742-b8c0-330b3d00d3e0 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:15.549720 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2ea7140d-a0bc-4742-b8c0-330b3d00d3e0 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1366 microversion: 2.1 time: 0.148515 Jul 25 06:03:15.550281 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 364/751] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:15 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:15.649082 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3eedbb59-1ec0-4cda-a9e6-0933f68e510e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:15.650045 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-3eedbb59-1ec0-4cda-a9e6-0933f68e510e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:15.656013 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3eedbb59-1ec0-4cda-a9e6-0933f68e510e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:15.656465 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3eedbb59-1ec0-4cda-a9e6-0933f68e510e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:15.657265 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3eedbb59-1ec0-4cda-a9e6-0933f68e510e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:15.657672 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3eedbb59-1ec0-4cda-a9e6-0933f68e510e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:15.687629 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-3eedbb59-1ec0-4cda-a9e6-0933f68e510e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043018 Jul 25 06:03:15.688199 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 388/752] 10.222.0.17 () {60 vars in 1342 bytes} [Mon Jul 25 06:03:15 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 06:03:16.377857 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ce758b6b-ac83-43ea-898e-844a33a48054 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:16.378512 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ce758b6b-ac83-43ea-898e-844a33a48054 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:16.384607 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ce758b6b-ac83-43ea-898e-844a33a48054 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:16.385054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ce758b6b-ac83-43ea-898e-844a33a48054 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:16.385807 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ce758b6b-ac83-43ea-898e-844a33a48054 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:16.386241 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ce758b6b-ac83-43ea-898e-844a33a48054 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:16.510856 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ce758b6b-ac83-43ea-898e-844a33a48054 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:16.518791 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ce758b6b-ac83-43ea-898e-844a33a48054 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.144717 Jul 25 06:03:16.519359 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 365/753] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:16 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:16.566052 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6706c68d-afdc-49ca-8222-9456c5b4d086 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:16.566703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6706c68d-afdc-49ca-8222-9456c5b4d086 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:16.573158 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6706c68d-afdc-49ca-8222-9456c5b4d086 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:16.573611 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6706c68d-afdc-49ca-8222-9456c5b4d086 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:16.574374 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6706c68d-afdc-49ca-8222-9456c5b4d086 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:16.574852 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6706c68d-afdc-49ca-8222-9456c5b4d086 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:16.700261 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d0a89038-0c89-413f-8b29-9613b4798d78 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:16.701137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6706c68d-afdc-49ca-8222-9456c5b4d086 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:16.701362 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d0a89038-0c89-413f-8b29-9613b4798d78 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:16.707844 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d0a89038-0c89-413f-8b29-9613b4798d78 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:16.708370 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d0a89038-0c89-413f-8b29-9613b4798d78 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:16.709571 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d0a89038-0c89-413f-8b29-9613b4798d78 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:16.709684 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6706c68d-afdc-49ca-8222-9456c5b4d086 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1366 microversion: 2.1 time: 0.146878 Jul 25 06:03:16.710011 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d0a89038-0c89-413f-8b29-9613b4798d78 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:16.710838 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 389/754] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:16 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:16.740852 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d0a89038-0c89-413f-8b29-9613b4798d78 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044935 Jul 25 06:03:16.741403 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 366/755] 10.222.0.17 () {60 vars in 1342 bytes} [Mon Jul 25 06:03:16 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 06:03:17.535575 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-03cac161-8e1d-4bf4-953e-46a6ff4f2d6e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:17.536185 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-03cac161-8e1d-4bf4-953e-46a6ff4f2d6e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:17.542960 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-03cac161-8e1d-4bf4-953e-46a6ff4f2d6e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:17.543407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-03cac161-8e1d-4bf4-953e-46a6ff4f2d6e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:17.544264 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-03cac161-8e1d-4bf4-953e-46a6ff4f2d6e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:17.544699 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-03cac161-8e1d-4bf4-953e-46a6ff4f2d6e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:17.674131 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-03cac161-8e1d-4bf4-953e-46a6ff4f2d6e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:17.683112 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-03cac161-8e1d-4bf4-953e-46a6ff4f2d6e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.151352 Jul 25 06:03:17.683677 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 390/756] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:17 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:17.726819 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b4cf5b04-ca17-4702-bab6-fed8a7764d1a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:17.727478 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b4cf5b04-ca17-4702-bab6-fed8a7764d1a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:17.734068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b4cf5b04-ca17-4702-bab6-fed8a7764d1a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:17.734542 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b4cf5b04-ca17-4702-bab6-fed8a7764d1a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:17.735301 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b4cf5b04-ca17-4702-bab6-fed8a7764d1a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:17.735734 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b4cf5b04-ca17-4702-bab6-fed8a7764d1a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:17.760580 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3ad8b560-dcd0-4f67-8558-15abb5b30339 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:17.761554 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-3ad8b560-dcd0-4f67-8558-15abb5b30339 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:17.769176 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3ad8b560-dcd0-4f67-8558-15abb5b30339 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:17.769630 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3ad8b560-dcd0-4f67-8558-15abb5b30339 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:17.770401 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3ad8b560-dcd0-4f67-8558-15abb5b30339 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:17.770895 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3ad8b560-dcd0-4f67-8558-15abb5b30339 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:17.803528 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-3ad8b560-dcd0-4f67-8558-15abb5b30339 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046202 Jul 25 06:03:17.804416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 391/757] 10.222.0.17 () {60 vars in 1342 bytes} [Mon Jul 25 06:03:17 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 06:03:17.874104 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b4cf5b04-ca17-4702-bab6-fed8a7764d1a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:17.881535 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b4cf5b04-ca17-4702-bab6-fed8a7764d1a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1366 microversion: 2.1 time: 0.159160 Jul 25 06:03:17.882105 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 367/758] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:17 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:18.700529 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a45593d1-854f-41f2-a21f-26660cfe7d75 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:18.701143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a45593d1-854f-41f2-a21f-26660cfe7d75 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:18.707746 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a45593d1-854f-41f2-a21f-26660cfe7d75 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:18.708199 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a45593d1-854f-41f2-a21f-26660cfe7d75 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:18.708965 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a45593d1-854f-41f2-a21f-26660cfe7d75 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:18.709428 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a45593d1-854f-41f2-a21f-26660cfe7d75 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:18.815073 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-567fd365-99c4-4cc4-9ed9-3d819bb88396 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:18.815999 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-567fd365-99c4-4cc4-9ed9-3d819bb88396 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:18.818318 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:18.823876 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-567fd365-99c4-4cc4-9ed9-3d819bb88396 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:18.824314 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-567fd365-99c4-4cc4-9ed9-3d819bb88396 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:18.825080 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-567fd365-99c4-4cc4-9ed9-3d819bb88396 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:18.826035 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-567fd365-99c4-4cc4-9ed9-3d819bb88396 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:18.841002 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a45593d1-854f-41f2-a21f-26660cfe7d75 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:18.849364 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a45593d1-854f-41f2-a21f-26660cfe7d75 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.152651 Jul 25 06:03:18.856385 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-567fd365-99c4-4cc4-9ed9-3d819bb88396 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045316 Jul 25 06:03:18.857222 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 368/759] 10.222.0.17 () {60 vars in 1342 bytes} [Mon Jul 25 06:03:18 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:18.859201 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 392/760] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:18 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:18.899492 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-63deea9b-95f1-49fe-8e92-56ac524bcd36 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:18.900102 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-63deea9b-95f1-49fe-8e92-56ac524bcd36 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:18.906122 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-63deea9b-95f1-49fe-8e92-56ac524bcd36 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:18.906604 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-63deea9b-95f1-49fe-8e92-56ac524bcd36 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:18.907396 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-63deea9b-95f1-49fe-8e92-56ac524bcd36 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:18.907829 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-63deea9b-95f1-49fe-8e92-56ac524bcd36 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:18.917792 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c0b69f7b-d9ef-469c-8295-9710d0a8f9cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:18.918281 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c0b69f7b-d9ef-469c-8295-9710d0a8f9cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:18.924158 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c0b69f7b-d9ef-469c-8295-9710d0a8f9cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:18.927146 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c0b69f7b-d9ef-469c-8295-9710d0a8f9cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:18.927146 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c0b69f7b-d9ef-469c-8295-9710d0a8f9cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:18.927146 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c0b69f7b-d9ef-469c-8295-9710d0a8f9cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:18.952422 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c0b69f7b-d9ef-469c-8295-9710d0a8f9cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Going to try to terminate instance {{(pid=130163) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:03:19.039595 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-63deea9b-95f1-49fe-8e92-56ac524bcd36 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:19.047289 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-63deea9b-95f1-49fe-8e92-56ac524bcd36 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1554 microversion: 2.1 time: 0.152221 Jul 25 06:03:19.047856 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 369/761] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:18 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:19.062974 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-54e5c067-1eca-4706-bc68-9449327c36c1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:19.063472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-54e5c067-1eca-4706-bc68-9449327c36c1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:19.069821 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-54e5c067-1eca-4706-bc68-9449327c36c1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:19.070268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-54e5c067-1eca-4706-bc68-9449327c36c1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:19.076676 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-54e5c067-1eca-4706-bc68-9449327c36c1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:19.076676 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-54e5c067-1eca-4706-bc68-9449327c36c1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:19.148693 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-54e5c067-1eca-4706-bc68-9449327c36c1 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089244 Jul 25 06:03:19.149284 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 370/762] 10.222.0.17 () {58 vars in 1274 bytes} [Mon Jul 25 06:03:19 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:03:19.265524 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c0b69f7b-d9ef-469c-8295-9710d0a8f9cc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "DELETE /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 204 len: 0 microversion: 2.20 time: 0.351452 Jul 25 06:03:19.266268 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 393/763] 10.222.0.17 () {60 vars in 1279 bytes} [Mon Jul 25 06:03:18 2022] DELETE /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 06:03:19.274949 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ffe1ca12-098e-4919-a063-e50e5e7f7eed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:19.275554 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ffe1ca12-098e-4919-a063-e50e5e7f7eed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:19.282122 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ffe1ca12-098e-4919-a063-e50e5e7f7eed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:19.282583 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ffe1ca12-098e-4919-a063-e50e5e7f7eed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:19.283336 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ffe1ca12-098e-4919-a063-e50e5e7f7eed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:19.283934 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ffe1ca12-098e-4919-a063-e50e5e7f7eed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:19.755052 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ffe1ca12-098e-4919-a063-e50e5e7f7eed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:19.763718 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ffe1ca12-098e-4919-a063-e50e5e7f7eed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:19.765223 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ffe1ca12-098e-4919-a063-e50e5e7f7eed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:19.766890 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ffe1ca12-098e-4919-a063-e50e5e7f7eed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1721 microversion: 2.20 time: 0.496034 Jul 25 06:03:19.767454 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 371/764] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:19 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1721 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:19.867694 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9b9e04eb-88ac-4502-ad60-bac9cbcee6ca tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:19.868506 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-9b9e04eb-88ac-4502-ad60-bac9cbcee6ca tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:19.875251 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9b9e04eb-88ac-4502-ad60-bac9cbcee6ca tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:19.875794 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9b9e04eb-88ac-4502-ad60-bac9cbcee6ca tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:19.876568 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9b9e04eb-88ac-4502-ad60-bac9cbcee6ca tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:19.877007 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9b9e04eb-88ac-4502-ad60-bac9cbcee6ca tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:20.005664 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9b9e04eb-88ac-4502-ad60-bac9cbcee6ca tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:20.016319 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9b9e04eb-88ac-4502-ad60-bac9cbcee6ca tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.153498 Jul 25 06:03:20.016891 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 394/765] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:19 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:20.489038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-d4cc79ba-efdf-4616-8560-b478831fe87f req-06f09c27-bfaf-4e70-893f-2caa11541f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a277f58b-99c2-4b07-a838-9f45f9009f92", "tag": "fa9ad9cc-f41d-4f22-aff2-361b56dc3035"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:20.498555 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-d4cc79ba-efdf-4616-8560-b478831fe87f req-06f09c27-bfaf-4e70-893f-2caa11541f72 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:20.499001 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-d4cc79ba-efdf-4616-8560-b478831fe87f req-06f09c27-bfaf-4e70-893f-2caa11541f72 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:20.511676 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-d4cc79ba-efdf-4616-8560-b478831fe87f req-06f09c27-bfaf-4e70-893f-2caa11541f72 service nova] Creating event network-changed:fa9ad9cc-f41d-4f22-aff2-361b56dc3035 for instance a277f58b-99c2-4b07-a838-9f45f9009f92 on hv-cinder-85083 Jul 25 06:03:20.516987 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-d4cc79ba-efdf-4616-8560-b478831fe87f req-06f09c27-bfaf-4e70-893f-2caa11541f72 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031574 Jul 25 06:03:20.517600 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 372/766] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:20.785343 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-743fa417-9c02-4887-9b1e-396f36217ae2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:20.787858 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-743fa417-9c02-4887-9b1e-396f36217ae2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:20.798370 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-743fa417-9c02-4887-9b1e-396f36217ae2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:20.802081 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-743fa417-9c02-4887-9b1e-396f36217ae2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:20.805873 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-743fa417-9c02-4887-9b1e-396f36217ae2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:20.805873 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-743fa417-9c02-4887-9b1e-396f36217ae2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:21.013159 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-743fa417-9c02-4887-9b1e-396f36217ae2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:21.021393 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-743fa417-9c02-4887-9b1e-396f36217ae2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:21.023049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-743fa417-9c02-4887-9b1e-396f36217ae2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:21.024228 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-743fa417-9c02-4887-9b1e-396f36217ae2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1721 microversion: 2.20 time: 0.242919 Jul 25 06:03:21.025184 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 395/767] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:20 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:03:21.034207 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-dcc70f8b-b6b6-4cc7-a157-ae21509878b8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:21.035055 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-dcc70f8b-b6b6-4cc7-a157-ae21509878b8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:21.041689 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dcc70f8b-b6b6-4cc7-a157-ae21509878b8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:21.042188 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dcc70f8b-b6b6-4cc7-a157-ae21509878b8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:21.043168 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dcc70f8b-b6b6-4cc7-a157-ae21509878b8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:21.043608 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dcc70f8b-b6b6-4cc7-a157-ae21509878b8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:21.244786 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-dcc70f8b-b6b6-4cc7-a157-ae21509878b8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:21.260868 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-dcc70f8b-b6b6-4cc7-a157-ae21509878b8 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.224752 Jul 25 06:03:21.260868 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 373/768] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:21 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:22.042128 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-60fb1609-98a0-43a5-80b2-1b2d11df7cd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:22.043663 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-60fb1609-98a0-43a5-80b2-1b2d11df7cd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:22.049792 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-60fb1609-98a0-43a5-80b2-1b2d11df7cd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:22.050250 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-60fb1609-98a0-43a5-80b2-1b2d11df7cd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:22.051052 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-60fb1609-98a0-43a5-80b2-1b2d11df7cd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:22.051492 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-60fb1609-98a0-43a5-80b2-1b2d11df7cd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:22.118983 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-60fb1609-98a0-43a5-80b2-1b2d11df7cd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:22.127718 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-60fb1609-98a0-43a5-80b2-1b2d11df7cd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:22.129631 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-60fb1609-98a0-43a5-80b2-1b2d11df7cd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:22.131375 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-60fb1609-98a0-43a5-80b2-1b2d11df7cd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1654 microversion: 2.20 time: 0.092941 Jul 25 06:03:22.131883 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 396/769] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:22 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1654 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:22.277215 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-358db36f-0edd-4a22-bf3c-685e9f52a42b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:22.278066 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-358db36f-0edd-4a22-bf3c-685e9f52a42b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:22.285033 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-358db36f-0edd-4a22-bf3c-685e9f52a42b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:22.285485 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-358db36f-0edd-4a22-bf3c-685e9f52a42b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:22.286365 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-358db36f-0edd-4a22-bf3c-685e9f52a42b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:22.286830 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-358db36f-0edd-4a22-bf3c-685e9f52a42b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:22.445827 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-358db36f-0edd-4a22-bf3c-685e9f52a42b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:22.453785 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-358db36f-0edd-4a22-bf3c-685e9f52a42b tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.180845 Jul 25 06:03:22.462267 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 374/770] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:22 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:22.532893 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-25b34608-b254-4ca9-a490-35aecf15ac12 req-b8363449-07ba-479b-9d73-1773ff035222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "348f256d-41e5-47d8-b165-cad6dfcd0be9", "name": "network-vif-deleted", "tag": "f9f7f9cc-3fd7-49f4-b8f2-59f247cf93e3"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:22.541962 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-25b34608-b254-4ca9-a490-35aecf15ac12 req-b8363449-07ba-479b-9d73-1773ff035222 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:22.542407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-25b34608-b254-4ca9-a490-35aecf15ac12 req-b8363449-07ba-479b-9d73-1773ff035222 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:22.553103 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-25b34608-b254-4ca9-a490-35aecf15ac12 req-b8363449-07ba-479b-9d73-1773ff035222 service nova] Creating event network-vif-deleted:f9f7f9cc-3fd7-49f4-b8f2-59f247cf93e3 for instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 on hv-cinder-85083 Jul 25 06:03:22.558013 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-25b34608-b254-4ca9-a490-35aecf15ac12 req-b8363449-07ba-479b-9d73-1773ff035222 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028706 Jul 25 06:03:22.562881 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 397/771] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:23.148861 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e3ddb672-7269-46b0-a846-3476da33bb93 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:23.149503 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e3ddb672-7269-46b0-a846-3476da33bb93 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:23.155656 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e3ddb672-7269-46b0-a846-3476da33bb93 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:23.156105 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e3ddb672-7269-46b0-a846-3476da33bb93 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:23.156900 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e3ddb672-7269-46b0-a846-3476da33bb93 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:23.157331 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e3ddb672-7269-46b0-a846-3476da33bb93 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:23.190008 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e3ddb672-7269-46b0-a846-3476da33bb93 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:23.190763 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e3ddb672-7269-46b0-a846-3476da33bb93 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:23.191218 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-e3ddb672-7269-46b0-a846-3476da33bb93 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lazy-loading 'fault' on Instance uuid 348f256d-41e5-47d8-b165-cad6dfcd0be9 {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:03:23.235634 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e3ddb672-7269-46b0-a846-3476da33bb93 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:23.244089 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e3ddb672-7269-46b0-a846-3476da33bb93 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:23.245592 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e3ddb672-7269-46b0-a846-3476da33bb93 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:23.246783 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e3ddb672-7269-46b0-a846-3476da33bb93 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 200 len: 1370 microversion: 2.20 time: 0.101872 Jul 25 06:03:23.247342 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 375/772] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:23 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 1370 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:23.472321 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-236fc45d-6ad3-471c-b6e2-530ca42f89f9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:23.473015 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-236fc45d-6ad3-471c-b6e2-530ca42f89f9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:23.479567 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-236fc45d-6ad3-471c-b6e2-530ca42f89f9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:23.480011 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-236fc45d-6ad3-471c-b6e2-530ca42f89f9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:23.480762 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-236fc45d-6ad3-471c-b6e2-530ca42f89f9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:23.481189 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-236fc45d-6ad3-471c-b6e2-530ca42f89f9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:23.613424 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-236fc45d-6ad3-471c-b6e2-530ca42f89f9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:23.621895 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-236fc45d-6ad3-471c-b6e2-530ca42f89f9 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.154185 Jul 25 06:03:23.622446 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 398/773] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:23 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:24.265200 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-5f24c3c8-4873-4e80-b5b1-49da2fe72bc4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:24.265724 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-5f24c3c8-4873-4e80-b5b1-49da2fe72bc4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:24.272815 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5f24c3c8-4873-4e80-b5b1-49da2fe72bc4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:24.273259 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5f24c3c8-4873-4e80-b5b1-49da2fe72bc4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:24.274013 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5f24c3c8-4873-4e80-b5b1-49da2fe72bc4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:24.274443 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5f24c3c8-4873-4e80-b5b1-49da2fe72bc4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:24.287660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-5f24c3c8-4873-4e80-b5b1-49da2fe72bc4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] HTTP exception thrown: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-5f24c3c8-4873-4e80-b5b1-49da2fe72bc4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Request method failure captured: Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 HTTP/1.1 Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEa3EM2d9zEpyK_f0kc4EkyDsQlwrxNJdez4UzHU68PFTaMda9jI7BibFba4S5DwSN3V7rcTy7nu_z4oyIcJ7303PdZcPYWaKqFv-xSS5Pi4EpifltyA5Q4bOMuwrk6PZXf5prPBFVwmuKuTTlnOPPTNHxSfV--zUVfDdnTLphiAc4 Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: d45136a1cdbf4e93b9cf71d33443220f Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:03:24.289268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:03:24.291266 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d45136a1cdbf4e93b9cf71d33443220f", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:03:24.291266 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:03:24.291266 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: d45136a1cdbf4e93b9cf71d33443220f Jul 25 06:03:24.291266 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:03:24.291266 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-AttachVolumeShelveTestJSON-981251187-project Jul 25 06:03:24.291266 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:03:24.291266 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:03:24.291266 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 7f269cd38f734209ba0496cf70469608 Jul 25 06:03:24.291266 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-AttachVolumeShelveTestJSON-981251187-project Jul 25 06:03:24.291266 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:03:24.291266 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. Jul 25 06:03:24.291266 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '348f256d-41e5-47d8-b165-cad6dfcd0be9'} Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:03:24.292196 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. Jul 25 06:03:24.293630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:24.295299 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-5f24c3c8-4873-4e80-b5b1-49da2fe72bc4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Returning 404 to user: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:03:24.295299 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-5f24c3c8-4873-4e80-b5b1-49da2fe72bc4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 404 len: 111 microversion: 2.20 time: 0.029657 Jul 25 06:03:24.295299 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 376/774] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:24 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 06:03:24.299601 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b4c427a0-4304-4e99-ad70-8af8cd3aafc2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '.version_select at 0x7f9d36172160>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:24.391675 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b4c427a0-4304-4e99-ad70-8af8cd3aafc2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-57793209" status: 204 len: 0 microversion: 2.20 time: 0.095741 Jul 25 06:03:24.392254 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 399/775] 10.222.0.17 () {60 vars in 1255 bytes} [Mon Jul 25 06:03:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-57793209 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 06:03:24.639095 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ce940ea0-d315-45fb-8b2d-a0ed30557c3d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:24.639709 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ce940ea0-d315-45fb-8b2d-a0ed30557c3d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:24.645850 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ce940ea0-d315-45fb-8b2d-a0ed30557c3d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:24.646296 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ce940ea0-d315-45fb-8b2d-a0ed30557c3d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:24.647590 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ce940ea0-d315-45fb-8b2d-a0ed30557c3d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:24.648023 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ce940ea0-d315-45fb-8b2d-a0ed30557c3d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:24.783708 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ce940ea0-d315-45fb-8b2d-a0ed30557c3d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:24.794219 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ce940ea0-d315-45fb-8b2d-a0ed30557c3d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.159106 Jul 25 06:03:24.794820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 377/776] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:24 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:25.157670 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-dc4da740-728e-4ca8-a9f8-442eea289920 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Action: 'create', calling method: .version_select at 0x7f9d36140820>, body: {"keypair": {"name": "tempest-keypair-622850988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAv42R9b36zqM8QHYd9Pxj6gskAlfK/T+PkJG3fHtEosRf2vaqRM1RkiY9eqdsuqeInTlZTWNhfZuX1NSBFdkPFrljPRm/XXcBEQ3IlRh3MF2xNNJCrJu5cxoiYRtUd+8w=="}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:25.173125 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-dc4da740-728e-4ca8-a9f8-442eea289920 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Getting quotas for project d45136a1cdbf4e93b9cf71d33443220f. Resources: {'key_pairs'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:03:25.176794 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-dc4da740-728e-4ca8-a9f8-442eea289920 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Getting quotas for user 7f269cd38f734209ba0496cf70469608 and project d45136a1cdbf4e93b9cf71d33443220f. Resources: {'key_pairs'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:03:25.251123 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-dc4da740-728e-4ca8-a9f8-442eea289920 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.097870 Jul 25 06:03:25.251722 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 400/777] 10.222.0.17 () {62 vars in 1199 bytes} [Mon Jul 25 06:03:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 06:03:25.811982 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-4dfa0794-af88-4297-9e47-7388e8149804 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:25.812605 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-4dfa0794-af88-4297-9e47-7388e8149804 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:25.819600 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4dfa0794-af88-4297-9e47-7388e8149804 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:25.820053 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4dfa0794-af88-4297-9e47-7388e8149804 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:25.820814 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4dfa0794-af88-4297-9e47-7388e8149804 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:25.821257 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4dfa0794-af88-4297-9e47-7388e8149804 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:25.971322 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4dfa0794-af88-4297-9e47-7388e8149804 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:25.979473 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-4dfa0794-af88-4297-9e47-7388e8149804 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.171329 Jul 25 06:03:25.979969 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 378/778] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:25 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:26.996761 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-46f85de6-4899-43ac-a5f1-8e3cad1252eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:26.997383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-46f85de6-4899-43ac-a5f1-8e3cad1252eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:26.999362 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:27.006572 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-46f85de6-4899-43ac-a5f1-8e3cad1252eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:27.007185 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-46f85de6-4899-43ac-a5f1-8e3cad1252eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:27.007802 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-46f85de6-4899-43ac-a5f1-8e3cad1252eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:27.008378 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-46f85de6-4899-43ac-a5f1-8e3cad1252eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:27.150455 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-46f85de6-4899-43ac-a5f1-8e3cad1252eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:27.159761 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-46f85de6-4899-43ac-a5f1-8e3cad1252eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.167273 Jul 25 06:03:27.160344 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 401/779] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:26 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:27.564353 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8f8b0ea4-4d1e-43de-b655-04b52f29e0cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1005359654", "imageRef": "bfffd6ef-7f99-4a99-90f3-027fe9c89821", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60c9a765-6850-40e2-8719-45a95f6696a2"}], "security_groups": [{"name": "tempest-securitygroup--1861067749"}], "key_name": "tempest-keypair-622850988", "user_data": "}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:27.670546 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.network.neutron [None req-8f8b0ea4-4d1e-43de-b655-04b52f29e0cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] validate_networks() for [('60c9a765-6850-40e2-8719-45a95f6696a2', None, None, None, None, None)] {{(pid=130162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:03:28.187669 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e8ddd6ed-8f9d-495c-920b-1f402c12e193 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:28.187669 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e8ddd6ed-8f9d-495c-920b-1f402c12e193 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:28.187669 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e8ddd6ed-8f9d-495c-920b-1f402c12e193 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:28.187669 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e8ddd6ed-8f9d-495c-920b-1f402c12e193 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:28.188402 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e8ddd6ed-8f9d-495c-920b-1f402c12e193 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:28.188402 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e8ddd6ed-8f9d-495c-920b-1f402c12e193 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:28.315535 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-8f8b0ea4-4d1e-43de-b655-04b52f29e0cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Flavor limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:03:28.315956 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-8f8b0ea4-4d1e-43de-b655-04b52f29e0cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Image limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:03:28.316431 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-8f8b0ea4-4d1e-43de-b655-04b52f29e0cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Flavor pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:03:28.316840 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-8f8b0ea4-4d1e-43de-b655-04b52f29e0cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Image pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:03:28.317250 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-8f8b0ea4-4d1e-43de-b655-04b52f29e0cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:03:28.326937 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e8ddd6ed-8f9d-495c-920b-1f402c12e193 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:28.333325 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8f8b0ea4-4d1e-43de-b655-04b52f29e0cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:28.333777 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8f8b0ea4-4d1e-43de-b655-04b52f29e0cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:28.334623 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8f8b0ea4-4d1e-43de-b655-04b52f29e0cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:28.335062 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8f8b0ea4-4d1e-43de-b655-04b52f29e0cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:28.347263 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e8ddd6ed-8f9d-495c-920b-1f402c12e193 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.173944 Jul 25 06:03:28.347864 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 402/780] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:28 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:28.359016 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-8f8b0ea4-4d1e-43de-b655-04b52f29e0cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Getting quotas for project d45136a1cdbf4e93b9cf71d33443220f. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:03:28.363654 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-8f8b0ea4-4d1e-43de-b655-04b52f29e0cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Getting quotas for user 7f269cd38f734209ba0496cf70469608 and project d45136a1cdbf4e93b9cf71d33443220f. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:03:28.375657 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8f8b0ea4-4d1e-43de-b655-04b52f29e0cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Going to run 1 instances... {{(pid=130162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:03:28.377925 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8f8b0ea4-4d1e-43de-b655-04b52f29e0cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfffd6ef-7f99-4a99-90f3-027fe9c89821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:03:28.514876 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-8f8b0ea4-4d1e-43de-b655-04b52f29e0cb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.954633 Jul 25 06:03:28.515542 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 379/781] 10.222.0.17 () {62 vars in 1187 bytes} [Mon Jul 25 06:03:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 06:03:28.525969 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e043424f-02bc-4477-9ebb-ce1e7a6b61a6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:28.526620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e043424f-02bc-4477-9ebb-ce1e7a6b61a6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:28.578428 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e043424f-02bc-4477-9ebb-ce1e7a6b61a6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:28.586490 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e043424f-02bc-4477-9ebb-ce1e7a6b61a6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:28.587999 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e043424f-02bc-4477-9ebb-ce1e7a6b61a6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:28.589469 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e043424f-02bc-4477-9ebb-ce1e7a6b61a6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1281 microversion: 2.20 time: 0.067891 Jul 25 06:03:28.590040 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 403/782] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:28 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:29.365648 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8895c3ee-2611-4ea4-b34b-bbdb173f9e6c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:29.366993 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8895c3ee-2611-4ea4-b34b-bbdb173f9e6c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:29.376422 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8895c3ee-2611-4ea4-b34b-bbdb173f9e6c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:29.377114 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8895c3ee-2611-4ea4-b34b-bbdb173f9e6c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:29.378479 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8895c3ee-2611-4ea4-b34b-bbdb173f9e6c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:29.379266 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8895c3ee-2611-4ea4-b34b-bbdb173f9e6c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:29.521447 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8895c3ee-2611-4ea4-b34b-bbdb173f9e6c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:29.529821 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-8895c3ee-2611-4ea4-b34b-bbdb173f9e6c tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1737 microversion: 2.1 time: 0.168586 Jul 25 06:03:29.530640 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 380/783] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:29 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:29.607855 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4acb3059-4c9c-41d1-9dfd-dc1f261361a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:29.608467 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4acb3059-4c9c-41d1-9dfd-dc1f261361a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:29.614932 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4acb3059-4c9c-41d1-9dfd-dc1f261361a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:29.615378 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4acb3059-4c9c-41d1-9dfd-dc1f261361a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:29.616824 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4acb3059-4c9c-41d1-9dfd-dc1f261361a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:29.617201 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4acb3059-4c9c-41d1-9dfd-dc1f261361a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:29.682465 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4acb3059-4c9c-41d1-9dfd-dc1f261361a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:29.690231 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4acb3059-4c9c-41d1-9dfd-dc1f261361a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:29.691775 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4acb3059-4c9c-41d1-9dfd-dc1f261361a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:29.692873 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4acb3059-4c9c-41d1-9dfd-dc1f261361a0 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1285 microversion: 2.20 time: 0.088846 Jul 25 06:03:29.693436 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 404/784] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:29 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:30.547485 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-046a0479-8fed-44b3-967a-e6c740628a2d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:30.548080 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-046a0479-8fed-44b3-967a-e6c740628a2d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:30.554561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-046a0479-8fed-44b3-967a-e6c740628a2d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:30.555026 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-046a0479-8fed-44b3-967a-e6c740628a2d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:30.555783 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-046a0479-8fed-44b3-967a-e6c740628a2d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:30.556215 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-046a0479-8fed-44b3-967a-e6c740628a2d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:30.693720 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-046a0479-8fed-44b3-967a-e6c740628a2d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:30.698451 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=100 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:30.703423 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-046a0479-8fed-44b3-967a-e6c740628a2d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1717 microversion: 2.1 time: 0.159873 Jul 25 06:03:30.704241 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 381/785] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:30 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:30.710029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6030ec2b-ee42-4222-8997-09e26b29204d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:30.711088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6030ec2b-ee42-4222-8997-09e26b29204d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:30.718019 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6030ec2b-ee42-4222-8997-09e26b29204d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:30.718465 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6030ec2b-ee42-4222-8997-09e26b29204d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:30.719544 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6030ec2b-ee42-4222-8997-09e26b29204d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:30.720145 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6030ec2b-ee42-4222-8997-09e26b29204d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:30.787469 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6030ec2b-ee42-4222-8997-09e26b29204d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:30.796172 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6030ec2b-ee42-4222-8997-09e26b29204d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:30.797946 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6030ec2b-ee42-4222-8997-09e26b29204d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:30.799081 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6030ec2b-ee42-4222-8997-09e26b29204d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1333 microversion: 2.20 time: 0.092939 Jul 25 06:03:30.799801 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 405/786] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:30 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:30.825756 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-77f4de4e-e1b2-4a81-ba75-d406952f68eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:30.826240 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-77f4de4e-e1b2-4a81-ba75-d406952f68eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:30.832961 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-77f4de4e-e1b2-4a81-ba75-d406952f68eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:30.833643 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-77f4de4e-e1b2-4a81-ba75-d406952f68eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:30.834438 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-77f4de4e-e1b2-4a81-ba75-d406952f68eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:30.834975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-77f4de4e-e1b2-4a81-ba75-d406952f68eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:30.914043 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-77f4de4e-e1b2-4a81-ba75-d406952f68eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] HTTP exception thrown: Cannot 'detach_volume' instance d7bc67af-311c-4441-bd3e-96e8387de26e while it is in vm_state rescued Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-77f4de4e-e1b2-4a81-ba75-d406952f68eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Request method failure captured: Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: DELETE /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/os-volume_attachments/d546ea5e-e274-471a-a2ee-48cbdff9e469 HTTP/1.1 Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEZ4GGYvj3dFL4Uvy0H58MbEz8LS_j1xNyRrePuqYNvuonp37ZlLQzY-ecjA9G73v3nGfUkWB72NIpUwhxL4BqIVyX_Mn5ZzBP_FUiEZF7oEl0i1jsl7C4MT7_85De_hItI1_J9Ix0rEBcWjJHmdYXrs4LT93CcXorpqBHUMGlS-DY Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: d30518907b9f4939b1e8666eba12186e Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-160252649 Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:03:30.915867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:03:30.922453 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d30518907b9f4939b1e8666eba12186e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d30518907b9f4939b1e8666eba12186e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d30518907b9f4939b1e8666eba12186e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d30518907b9f4939b1e8666eba12186e", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:03:30.922453 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-ServerRescueNegativeTestJSON-160252649 Jul 25 06:03:30.922453 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: d30518907b9f4939b1e8666eba12186e Jul 25 06:03:30.922453 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-160252649 Jul 25 06:03:30.922453 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-ServerRescueNegativeTestJSON-160252649-project Jul 25 06:03:30.922453 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:03:30.922453 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:03:30.922453 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 13e5d648af294c7cbc86ccd362914728 Jul 25 06:03:30.922453 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-ServerRescueNegativeTestJSON-160252649-project Jul 25 06:03:30.922453 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:03:30.922453 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Cannot 'detach_volume' instance d7bc67af-311c-4441-bd3e-96e8387de26e while it is in vm_state rescued Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'server_id': 'd7bc67af-311c-4441-bd3e-96e8387de26e', 'id': 'd546ea5e-e274-471a-a2ee-48cbdff9e469'} Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d7bc67af-311c-4441-bd3e-96e8387de26e in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:03:30.923297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:03:30.924738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 25 06:03:30.924738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 06:03:30.924738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 06:03:30.924738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 06:03:30.924738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d7bc67af-311c-4441-bd3e-96e8387de26e while it is in vm_state rescued Jul 25 06:03:30.924738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:30.924738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:30.924738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:30.924738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:30.924738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:30.924738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:30.924738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:03:30.924738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:03:30.924738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d7bc67af-311c-4441-bd3e-96e8387de26e while it is in vm_state rescued Jul 25 06:03:30.924738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:30.924738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-77f4de4e-e1b2-4a81-ba75-d406952f68eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Returning 409 to user: Cannot 'detach_volume' instance d7bc67af-311c-4441-bd3e-96e8387de26e while it is in vm_state rescued {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:03:30.925882 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-77f4de4e-e1b2-4a81-ba75-d406952f68eb tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/os-volume_attachments/d546ea5e-e274-471a-a2ee-48cbdff9e469" status: 409 len: 152 microversion: 2.1 time: 0.095545 Jul 25 06:03:30.925882 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 382/787] 10.222.0.17 () {58 vars in 1415 bytes} [Mon Jul 25 06:03:30 2022] DELETE /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/os-volume_attachments/d546ea5e-e274-471a-a2ee-48cbdff9e469 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 06:03:30.931575 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d53b9f20-374b-4c08-8785-d0c554c4124d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:30.932115 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d53b9f20-374b-4c08-8785-d0c554c4124d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:30.938041 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d53b9f20-374b-4c08-8785-d0c554c4124d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:30.938542 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d53b9f20-374b-4c08-8785-d0c554c4124d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:30.939418 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d53b9f20-374b-4c08-8785-d0c554c4124d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:30.939778 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d53b9f20-374b-4c08-8785-d0c554c4124d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:30.943547 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:31.180255 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d53b9f20-374b-4c08-8785-d0c554c4124d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "POST /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/action" status: 202 len: 0 microversion: 2.1 time: 0.252740 Jul 25 06:03:31.182701 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 406/788] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 06:03:30 2022] POST /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:03:31.189113 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3bdd62cd-4e64-4b79-8c7b-31f2cd752585 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:31.189725 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3bdd62cd-4e64-4b79-8c7b-31f2cd752585 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:31.197411 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3bdd62cd-4e64-4b79-8c7b-31f2cd752585 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:31.198155 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3bdd62cd-4e64-4b79-8c7b-31f2cd752585 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:31.199158 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3bdd62cd-4e64-4b79-8c7b-31f2cd752585 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:31.199789 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3bdd62cd-4e64-4b79-8c7b-31f2cd752585 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:31.431720 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3bdd62cd-4e64-4b79-8c7b-31f2cd752585 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:31.440915 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3bdd62cd-4e64-4b79-8c7b-31f2cd752585 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1725 microversion: 2.1 time: 0.255797 Jul 25 06:03:31.441826 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 383/789] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:31 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:31.818158 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-632a7b97-2ed2-4e5a-84b3-468d1c31d75a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:31.819112 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-632a7b97-2ed2-4e5a-84b3-468d1c31d75a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:31.825457 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-632a7b97-2ed2-4e5a-84b3-468d1c31d75a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:31.826030 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-632a7b97-2ed2-4e5a-84b3-468d1c31d75a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:31.826890 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-632a7b97-2ed2-4e5a-84b3-468d1c31d75a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:31.827379 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-632a7b97-2ed2-4e5a-84b3-468d1c31d75a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:31.894362 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-632a7b97-2ed2-4e5a-84b3-468d1c31d75a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:31.902790 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-632a7b97-2ed2-4e5a-84b3-468d1c31d75a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:31.904452 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-632a7b97-2ed2-4e5a-84b3-468d1c31d75a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:31.905579 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-632a7b97-2ed2-4e5a-84b3-468d1c31d75a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1339 microversion: 2.20 time: 0.092155 Jul 25 06:03:31.906139 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 407/790] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:31 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1339 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:32.458114 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-457dc71d-714a-4c5f-8511-c42d630d34b5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:32.458753 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-457dc71d-714a-4c5f-8511-c42d630d34b5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:32.465270 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-457dc71d-714a-4c5f-8511-c42d630d34b5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:32.465716 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-457dc71d-714a-4c5f-8511-c42d630d34b5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:32.466486 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-457dc71d-714a-4c5f-8511-c42d630d34b5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:32.466926 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-457dc71d-714a-4c5f-8511-c42d630d34b5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:32.596105 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-457dc71d-714a-4c5f-8511-c42d630d34b5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:32.604535 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-457dc71d-714a-4c5f-8511-c42d630d34b5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1725 microversion: 2.1 time: 0.150255 Jul 25 06:03:32.605101 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 384/791] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:32 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:32.924032 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3cfbde86-7f5d-4d36-978f-a7a42f9c98a9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:32.924651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-3cfbde86-7f5d-4d36-978f-a7a42f9c98a9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:32.931178 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3cfbde86-7f5d-4d36-978f-a7a42f9c98a9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:32.931631 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3cfbde86-7f5d-4d36-978f-a7a42f9c98a9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:32.932397 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3cfbde86-7f5d-4d36-978f-a7a42f9c98a9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:32.932843 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3cfbde86-7f5d-4d36-978f-a7a42f9c98a9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:33.064093 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3cfbde86-7f5d-4d36-978f-a7a42f9c98a9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:33.071978 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3cfbde86-7f5d-4d36-978f-a7a42f9c98a9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:33.073492 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3cfbde86-7f5d-4d36-978f-a7a42f9c98a9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:33.074645 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-3cfbde86-7f5d-4d36-978f-a7a42f9c98a9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1407 microversion: 2.20 time: 0.154507 Jul 25 06:03:33.075201 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 408/792] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:32 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:33.622286 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-c162d2d5-ce7e-4d34-b5de-473bb4a56007 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:33.622937 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-c162d2d5-ce7e-4d34-b5de-473bb4a56007 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:33.629388 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c162d2d5-ce7e-4d34-b5de-473bb4a56007 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:33.632889 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c162d2d5-ce7e-4d34-b5de-473bb4a56007 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:33.632889 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c162d2d5-ce7e-4d34-b5de-473bb4a56007 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:33.632889 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c162d2d5-ce7e-4d34-b5de-473bb4a56007 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:33.816935 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-c162d2d5-ce7e-4d34-b5de-473bb4a56007 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:33.825049 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-c162d2d5-ce7e-4d34-b5de-473bb4a56007 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1725 microversion: 2.1 time: 0.207252 Jul 25 06:03:33.825649 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 385/793] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:33 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:34.094870 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-86f35cc4-74e2-4836-b99d-c0f276478948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:34.094870 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-86f35cc4-74e2-4836-b99d-c0f276478948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:34.099804 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-86f35cc4-74e2-4836-b99d-c0f276478948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:34.100260 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-86f35cc4-74e2-4836-b99d-c0f276478948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:34.101032 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-86f35cc4-74e2-4836-b99d-c0f276478948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:34.101463 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-86f35cc4-74e2-4836-b99d-c0f276478948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:34.218164 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-51b75877-25f1-49bc-8f21-ba4a463c362f req-39f97166-ba6c-4606-8629-f3542956e464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339de78a-2525-478a-842f-faea8fc424e2", "tag": "5f811af2-0e22-4934-ac4e-1b3da227067b"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:34.231843 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-51b75877-25f1-49bc-8f21-ba4a463c362f req-39f97166-ba6c-4606-8629-f3542956e464 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:34.232538 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-51b75877-25f1-49bc-8f21-ba4a463c362f req-39f97166-ba6c-4606-8629-f3542956e464 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:34.235797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-86f35cc4-74e2-4836-b99d-c0f276478948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:34.246533 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-86f35cc4-74e2-4836-b99d-c0f276478948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:34.248156 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-86f35cc4-74e2-4836-b99d-c0f276478948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:34.249211 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-86f35cc4-74e2-4836-b99d-c0f276478948 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1407 microversion: 2.20 time: 0.160220 Jul 25 06:03:34.250134 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 409/794] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:34 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:34.256938 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-51b75877-25f1-49bc-8f21-ba4a463c362f req-39f97166-ba6c-4606-8629-f3542956e464 service nova] Creating event network-changed:5f811af2-0e22-4934-ac4e-1b3da227067b for instance 339de78a-2525-478a-842f-faea8fc424e2 on hv-cinder-85083 Jul 25 06:03:34.263594 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-51b75877-25f1-49bc-8f21-ba4a463c362f req-39f97166-ba6c-4606-8629-f3542956e464 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049343 Jul 25 06:03:34.272704 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 386/795] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:34.842425 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-39728808-6ca3-4f58-a912-658d60de2fbd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:34.843068 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-39728808-6ca3-4f58-a912-658d60de2fbd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:34.849741 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-39728808-6ca3-4f58-a912-658d60de2fbd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:34.850235 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-39728808-6ca3-4f58-a912-658d60de2fbd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:34.851024 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-39728808-6ca3-4f58-a912-658d60de2fbd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:34.851481 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-39728808-6ca3-4f58-a912-658d60de2fbd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:35.142640 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-39728808-6ca3-4f58-a912-658d60de2fbd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:35.151391 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-39728808-6ca3-4f58-a912-658d60de2fbd tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1731 microversion: 2.1 time: 0.312866 Jul 25 06:03:35.151977 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 410/796] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:34 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1731 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:35.169535 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f3468d3c-4c67-4100-9f48-91ed6f520099 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:35.170114 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f3468d3c-4c67-4100-9f48-91ed6f520099 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:35.176347 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f3468d3c-4c67-4100-9f48-91ed6f520099 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:35.176792 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f3468d3c-4c67-4100-9f48-91ed6f520099 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:35.177550 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f3468d3c-4c67-4100-9f48-91ed6f520099 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:35.177978 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f3468d3c-4c67-4100-9f48-91ed6f520099 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:35.255756 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f3468d3c-4c67-4100-9f48-91ed6f520099 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091879 Jul 25 06:03:35.256421 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 387/797] 10.222.0.17 () {58 vars in 1274 bytes} [Mon Jul 25 06:03:35 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:35.266803 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d6bac37d-c5eb-4fc7-ab3d-bee00ba525f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:35.267587 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d6bac37d-c5eb-4fc7-ab3d-bee00ba525f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:35.273838 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d6bac37d-c5eb-4fc7-ab3d-bee00ba525f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:35.274941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d6bac37d-c5eb-4fc7-ab3d-bee00ba525f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:35.275711 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d6bac37d-c5eb-4fc7-ab3d-bee00ba525f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:35.276145 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d6bac37d-c5eb-4fc7-ab3d-bee00ba525f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:35.412287 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d6bac37d-c5eb-4fc7-ab3d-bee00ba525f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:35.421583 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d6bac37d-c5eb-4fc7-ab3d-bee00ba525f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:35.423286 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d6bac37d-c5eb-4fc7-ab3d-bee00ba525f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:35.424388 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d6bac37d-c5eb-4fc7-ab3d-bee00ba525f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1407 microversion: 2.20 time: 0.161623 Jul 25 06:03:35.424925 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 411/798] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:35 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:36.278520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-6ac2d62b-92cc-4985-a04f-59790e4859f8 req-ef94e2b5-14da-4b86-9035-248f809121ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7bc67af-311c-4441-bd3e-96e8387de26e", "tag": "a31d1086-8cc8-4cdd-8ab6-2db983070eae"}, {"name": "network-changed", "server_uuid": "d7bc67af-311c-4441-bd3e-96e8387de26e", "tag": "a31d1086-8cc8-4cdd-8ab6-2db983070eae"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:36.286832 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-6ac2d62b-92cc-4985-a04f-59790e4859f8 req-ef94e2b5-14da-4b86-9035-248f809121ce service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:36.287277 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-6ac2d62b-92cc-4985-a04f-59790e4859f8 req-ef94e2b5-14da-4b86-9035-248f809121ce service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:36.298496 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-6ac2d62b-92cc-4985-a04f-59790e4859f8 req-ef94e2b5-14da-4b86-9035-248f809121ce service nova] Creating event network-changed:a31d1086-8cc8-4cdd-8ab6-2db983070eae for instance d7bc67af-311c-4441-bd3e-96e8387de26e on hv-cinder-85083 Jul 25 06:03:36.299128 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-6ac2d62b-92cc-4985-a04f-59790e4859f8 req-ef94e2b5-14da-4b86-9035-248f809121ce service nova] Creating event network-changed:a31d1086-8cc8-4cdd-8ab6-2db983070eae for instance d7bc67af-311c-4441-bd3e-96e8387de26e on hv-cinder-85083 Jul 25 06:03:36.303982 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-6ac2d62b-92cc-4985-a04f-59790e4859f8 req-ef94e2b5-14da-4b86-9035-248f809121ce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.030445 Jul 25 06:03:36.304573 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 388/799] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:03:36.443458 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8774573c-bcc6-45fc-af78-6923151e7cfc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:36.445195 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8774573c-bcc6-45fc-af78-6923151e7cfc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:36.453383 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8774573c-bcc6-45fc-af78-6923151e7cfc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:36.454023 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8774573c-bcc6-45fc-af78-6923151e7cfc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:36.454951 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8774573c-bcc6-45fc-af78-6923151e7cfc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:36.455493 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8774573c-bcc6-45fc-af78-6923151e7cfc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:36.601412 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8774573c-bcc6-45fc-af78-6923151e7cfc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:36.614638 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8774573c-bcc6-45fc-af78-6923151e7cfc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:36.616462 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8774573c-bcc6-45fc-af78-6923151e7cfc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:36.618320 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8774573c-bcc6-45fc-af78-6923151e7cfc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1407 microversion: 2.20 time: 0.178776 Jul 25 06:03:36.629054 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 412/800] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:36 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:37.638285 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cfebf18a-2396-45d3-aa44-6527e6e38dc9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:37.639025 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-cfebf18a-2396-45d3-aa44-6527e6e38dc9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:37.645252 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cfebf18a-2396-45d3-aa44-6527e6e38dc9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:37.645699 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cfebf18a-2396-45d3-aa44-6527e6e38dc9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:37.646459 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cfebf18a-2396-45d3-aa44-6527e6e38dc9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:37.646927 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cfebf18a-2396-45d3-aa44-6527e6e38dc9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:37.785651 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cfebf18a-2396-45d3-aa44-6527e6e38dc9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:37.794194 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cfebf18a-2396-45d3-aa44-6527e6e38dc9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:37.798594 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cfebf18a-2396-45d3-aa44-6527e6e38dc9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:37.798594 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-cfebf18a-2396-45d3-aa44-6527e6e38dc9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1407 microversion: 2.20 time: 0.163886 Jul 25 06:03:37.798594 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 389/801] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:37 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:38.814605 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8f50b1aa-8ac9-4f19-af73-b69e1b42af1a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:38.815213 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8f50b1aa-8ac9-4f19-af73-b69e1b42af1a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:38.817405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=6 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:38.822679 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8f50b1aa-8ac9-4f19-af73-b69e1b42af1a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:38.823127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8f50b1aa-8ac9-4f19-af73-b69e1b42af1a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:38.823887 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8f50b1aa-8ac9-4f19-af73-b69e1b42af1a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:38.824314 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8f50b1aa-8ac9-4f19-af73-b69e1b42af1a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:38.956900 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8f50b1aa-8ac9-4f19-af73-b69e1b42af1a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:38.965370 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8f50b1aa-8ac9-4f19-af73-b69e1b42af1a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:38.966897 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8f50b1aa-8ac9-4f19-af73-b69e1b42af1a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:38.968036 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8f50b1aa-8ac9-4f19-af73-b69e1b42af1a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1407 microversion: 2.20 time: 0.157344 Jul 25 06:03:38.968586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 413/802] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:38 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:39.179551 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-98b9e658-fbe0-435a-9fd0-36e246847180 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:39.181647 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-98b9e658-fbe0-435a-9fd0-36e246847180 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:39.183601 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=2 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:39.184263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=6 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:39.189555 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-98b9e658-fbe0-435a-9fd0-36e246847180 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:39.196225 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-98b9e658-fbe0-435a-9fd0-36e246847180 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:39.196225 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-98b9e658-fbe0-435a-9fd0-36e246847180 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:39.196225 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-98b9e658-fbe0-435a-9fd0-36e246847180 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:39.370983 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-98b9e658-fbe0-435a-9fd0-36e246847180 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.195168 Jul 25 06:03:39.371528 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 390/803] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:03:39 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437/os-volume_attachments => generated 25 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 06:03:39.439583 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-498c5b9a-33ab-4831-a680-ee0da7801f99 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:39.440088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-498c5b9a-33ab-4831-a680-ee0da7801f99 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:39.447462 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-498c5b9a-33ab-4831-a680-ee0da7801f99 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:39.447908 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-498c5b9a-33ab-4831-a680-ee0da7801f99 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:39.449792 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-498c5b9a-33ab-4831-a680-ee0da7801f99 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:39.450235 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-498c5b9a-33ab-4831-a680-ee0da7801f99 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:39.479746 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-498c5b9a-33ab-4831-a680-ee0da7801f99 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Going to try to terminate instance {{(pid=130163) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:03:39.753228 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-498c5b9a-33ab-4831-a680-ee0da7801f99 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 204 len: 0 microversion: 2.1 time: 0.317314 Jul 25 06:03:39.753746 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 414/804] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:03:39 2022] DELETE /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:03:39.762693 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-89d8ca1b-0fa0-4b2d-98fc-1c03e4c387c9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:39.763318 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-89d8ca1b-0fa0-4b2d-98fc-1c03e4c387c9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:39.769665 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-89d8ca1b-0fa0-4b2d-98fc-1c03e4c387c9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:39.770173 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-89d8ca1b-0fa0-4b2d-98fc-1c03e4c387c9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:39.770935 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-89d8ca1b-0fa0-4b2d-98fc-1c03e4c387c9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:39.771375 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-89d8ca1b-0fa0-4b2d-98fc-1c03e4c387c9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:39.986841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2fe1d640-d5d0-469a-a7f2-b2dedb7fb895 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:39.987545 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2fe1d640-d5d0-469a-a7f2-b2dedb7fb895 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:39.994555 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2fe1d640-d5d0-469a-a7f2-b2dedb7fb895 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:39.995003 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2fe1d640-d5d0-469a-a7f2-b2dedb7fb895 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:39.995783 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2fe1d640-d5d0-469a-a7f2-b2dedb7fb895 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:39.996197 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2fe1d640-d5d0-469a-a7f2-b2dedb7fb895 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:40.106791 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-89d8ca1b-0fa0-4b2d-98fc-1c03e4c387c9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:40.114611 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-89d8ca1b-0fa0-4b2d-98fc-1c03e4c387c9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1676 microversion: 2.1 time: 0.356572 Jul 25 06:03:40.115260 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 391/805] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:39 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1676 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:40.131751 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2fe1d640-d5d0-469a-a7f2-b2dedb7fb895 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:40.143356 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2fe1d640-d5d0-469a-a7f2-b2dedb7fb895 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:40.146079 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2fe1d640-d5d0-469a-a7f2-b2dedb7fb895 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:40.146347 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2fe1d640-d5d0-469a-a7f2-b2dedb7fb895 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1407 microversion: 2.20 time: 0.163810 Jul 25 06:03:40.146968 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 415/806] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:39 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:03:40.316382 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-a17c78fd-48ae-4080-ade1-f513417852b3 req-97c4f5d4-408b-4583-833f-f018a1ac05ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339de78a-2525-478a-842f-faea8fc424e2", "name": "network-vif-plugged", "status": "completed", "tag": "5f811af2-0e22-4934-ac4e-1b3da227067b"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:40.324987 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-a17c78fd-48ae-4080-ade1-f513417852b3 req-97c4f5d4-408b-4583-833f-f018a1ac05ce service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:40.325432 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-a17c78fd-48ae-4080-ade1-f513417852b3 req-97c4f5d4-408b-4583-833f-f018a1ac05ce service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:40.335914 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-a17c78fd-48ae-4080-ade1-f513417852b3 req-97c4f5d4-408b-4583-833f-f018a1ac05ce service nova] Creating event network-vif-plugged:5f811af2-0e22-4934-ac4e-1b3da227067b for instance 339de78a-2525-478a-842f-faea8fc424e2 on hv-cinder-85083 Jul 25 06:03:40.341232 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-a17c78fd-48ae-4080-ade1-f513417852b3 req-97c4f5d4-408b-4583-833f-f018a1ac05ce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028705 Jul 25 06:03:40.341968 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 392/807] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:41.135026 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f0766f85-ca1d-46ac-8c0c-717ac1ac9a55 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:41.135647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f0766f85-ca1d-46ac-8c0c-717ac1ac9a55 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:41.141539 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f0766f85-ca1d-46ac-8c0c-717ac1ac9a55 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:41.141988 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f0766f85-ca1d-46ac-8c0c-717ac1ac9a55 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:41.142784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f0766f85-ca1d-46ac-8c0c-717ac1ac9a55 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:41.143218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f0766f85-ca1d-46ac-8c0c-717ac1ac9a55 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:41.165761 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-09e3a5b8-ab4b-4a44-937f-b73b684578d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:41.166388 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-09e3a5b8-ab4b-4a44-937f-b73b684578d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:41.173546 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-09e3a5b8-ab4b-4a44-937f-b73b684578d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:41.174020 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-09e3a5b8-ab4b-4a44-937f-b73b684578d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:41.174868 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-09e3a5b8-ab4b-4a44-937f-b73b684578d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:41.175331 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-09e3a5b8-ab4b-4a44-937f-b73b684578d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:41.310339 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-09e3a5b8-ab4b-4a44-937f-b73b684578d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:41.319056 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-09e3a5b8-ab4b-4a44-937f-b73b684578d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:41.320573 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-09e3a5b8-ab4b-4a44-937f-b73b684578d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:41.322266 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-09e3a5b8-ab4b-4a44-937f-b73b684578d5 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1407 microversion: 2.20 time: 0.161196 Jul 25 06:03:41.322857 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 393/808] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:41 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:03:41.523696 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f0766f85-ca1d-46ac-8c0c-717ac1ac9a55 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:41.531082 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f0766f85-ca1d-46ac-8c0c-717ac1ac9a55 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1676 microversion: 2.1 time: 0.402393 Jul 25 06:03:41.531647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 416/809] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:41 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1676 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:42.340718 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-30032ee1-b3a0-4188-a2ef-8bb7ee824370 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:42.341330 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-30032ee1-b3a0-4188-a2ef-8bb7ee824370 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:42.348057 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-30032ee1-b3a0-4188-a2ef-8bb7ee824370 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:42.348710 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-30032ee1-b3a0-4188-a2ef-8bb7ee824370 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:42.349465 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-30032ee1-b3a0-4188-a2ef-8bb7ee824370 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:42.349898 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-30032ee1-b3a0-4188-a2ef-8bb7ee824370 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:42.549331 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c9e39c82-ef12-4185-bb8a-ed82bb9a8446 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:42.549952 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c9e39c82-ef12-4185-bb8a-ed82bb9a8446 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:42.550790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-30032ee1-b3a0-4188-a2ef-8bb7ee824370 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:42.557335 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c9e39c82-ef12-4185-bb8a-ed82bb9a8446 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:42.557785 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c9e39c82-ef12-4185-bb8a-ed82bb9a8446 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:42.558580 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c9e39c82-ef12-4185-bb8a-ed82bb9a8446 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:42.559019 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c9e39c82-ef12-4185-bb8a-ed82bb9a8446 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:42.562776 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-30032ee1-b3a0-4188-a2ef-8bb7ee824370 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:42.569126 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-30032ee1-b3a0-4188-a2ef-8bb7ee824370 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:42.569126 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-30032ee1-b3a0-4188-a2ef-8bb7ee824370 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1407 microversion: 2.20 time: 0.229506 Jul 25 06:03:42.569126 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 394/810] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:42 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:42.693350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-c9e39c82-ef12-4185-bb8a-ed82bb9a8446 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:42.701053 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c9e39c82-ef12-4185-bb8a-ed82bb9a8446 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1676 microversion: 2.1 time: 0.155590 Jul 25 06:03:42.701630 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 417/811] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:42 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:43.071723 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-9f449684-5044-411e-96ef-3ea9e1478641 req-3560a605-aae6-4061-9901-136fc55376b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b706acf-4c08-4ea0-8086-3091278ad437", "name": "network-vif-deleted", "tag": "1e1fdc90-5262-49b6-b5ce-47ed89f39541"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:43.079982 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-9f449684-5044-411e-96ef-3ea9e1478641 req-3560a605-aae6-4061-9901-136fc55376b5 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.080407 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-9f449684-5044-411e-96ef-3ea9e1478641 req-3560a605-aae6-4061-9901-136fc55376b5 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.094775 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-9f449684-5044-411e-96ef-3ea9e1478641 req-3560a605-aae6-4061-9901-136fc55376b5 service nova] Creating event network-vif-deleted:1e1fdc90-5262-49b6-b5ce-47ed89f39541 for instance 0b706acf-4c08-4ea0-8086-3091278ad437 on hv-cinder-85083 Jul 25 06:03:43.099853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-9f449684-5044-411e-96ef-3ea9e1478641 req-3560a605-aae6-4061-9901-136fc55376b5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032261 Jul 25 06:03:43.103491 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 395/812] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:43.583837 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-fb88a3ef-caec-4ecb-8378-8300ec5ef7fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:43.584550 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-fb88a3ef-caec-4ecb-8378-8300ec5ef7fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:43.591581 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fb88a3ef-caec-4ecb-8378-8300ec5ef7fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.592161 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fb88a3ef-caec-4ecb-8378-8300ec5ef7fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.593047 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fb88a3ef-caec-4ecb-8378-8300ec5ef7fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.593612 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fb88a3ef-caec-4ecb-8378-8300ec5ef7fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.719886 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-97e84798-d802-43f6-8805-b52cb8ea207d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:43.720593 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-97e84798-d802-43f6-8805-b52cb8ea207d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:43.726922 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-97e84798-d802-43f6-8805-b52cb8ea207d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.727588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-97e84798-d802-43f6-8805-b52cb8ea207d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.728824 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-97e84798-d802-43f6-8805-b52cb8ea207d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.729260 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-97e84798-d802-43f6-8805-b52cb8ea207d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.734239 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-fb88a3ef-caec-4ecb-8378-8300ec5ef7fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:43.744246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-fb88a3ef-caec-4ecb-8378-8300ec5ef7fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:43.749802 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-fb88a3ef-caec-4ecb-8378-8300ec5ef7fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:43.749802 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-fb88a3ef-caec-4ecb-8378-8300ec5ef7fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1407 microversion: 2.20 time: 0.167238 Jul 25 06:03:43.749802 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 418/813] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:43 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:43.810495 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-97e84798-d802-43f6-8805-b52cb8ea207d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:43.821794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-97e84798-d802-43f6-8805-b52cb8ea207d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1323 microversion: 2.1 time: 0.106687 Jul 25 06:03:43.823059 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 396/814] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:43 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1323 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:44.770332 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a3d58ff8-37c3-4f65-8c7b-9225ef8ff268 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:44.770987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a3d58ff8-37c3-4f65-8c7b-9225ef8ff268 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:44.778323 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a3d58ff8-37c3-4f65-8c7b-9225ef8ff268 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:44.778800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a3d58ff8-37c3-4f65-8c7b-9225ef8ff268 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:44.779703 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a3d58ff8-37c3-4f65-8c7b-9225ef8ff268 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:44.780134 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a3d58ff8-37c3-4f65-8c7b-9225ef8ff268 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:44.839154 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1df65a39-754a-495c-8493-2e00f65c8f6c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:44.839755 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1df65a39-754a-495c-8493-2e00f65c8f6c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:44.846315 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1df65a39-754a-495c-8493-2e00f65c8f6c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:44.846947 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1df65a39-754a-495c-8493-2e00f65c8f6c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:44.847768 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1df65a39-754a-495c-8493-2e00f65c8f6c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:44.848200 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1df65a39-754a-495c-8493-2e00f65c8f6c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:44.881177 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1df65a39-754a-495c-8493-2e00f65c8f6c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:44.881650 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1df65a39-754a-495c-8493-2e00f65c8f6c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:44.882127 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-1df65a39-754a-495c-8493-2e00f65c8f6c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lazy-loading 'fault' on Instance uuid 0b706acf-4c08-4ea0-8086-3091278ad437 {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:03:44.921046 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a3d58ff8-37c3-4f65-8c7b-9225ef8ff268 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:44.927142 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1df65a39-754a-495c-8493-2e00f65c8f6c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:44.932836 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a3d58ff8-37c3-4f65-8c7b-9225ef8ff268 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:44.932836 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a3d58ff8-37c3-4f65-8c7b-9225ef8ff268 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:44.932836 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a3d58ff8-37c3-4f65-8c7b-9225ef8ff268 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1598 microversion: 2.20 time: 0.170664 Jul 25 06:03:44.933299 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 419/815] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:44 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:44.934375 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1df65a39-754a-495c-8493-2e00f65c8f6c tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 200 len: 1328 microversion: 2.1 time: 0.099215 Jul 25 06:03:44.934968 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 397/816] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:44 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:44.950320 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c5c65fb2-86c1-49f0-8e00-e41b4ff0874c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:44.950842 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c5c65fb2-86c1-49f0-8e00-e41b4ff0874c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:44.956716 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c5c65fb2-86c1-49f0-8e00-e41b4ff0874c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:44.960789 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c5c65fb2-86c1-49f0-8e00-e41b4ff0874c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:44.960789 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c5c65fb2-86c1-49f0-8e00-e41b4ff0874c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:44.960789 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c5c65fb2-86c1-49f0-8e00-e41b4ff0874c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:44.961983 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:45.036651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c5c65fb2-86c1-49f0-8e00-e41b4ff0874c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090581 Jul 25 06:03:45.037246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 420/817] 10.222.0.17 () {60 vars in 1315 bytes} [Mon Jul 25 06:03:44 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 06:03:45.951220 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2e04e559-f501-459d-a122-ed7138e908c0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:45.951827 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2e04e559-f501-459d-a122-ed7138e908c0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:45.958434 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2e04e559-f501-459d-a122-ed7138e908c0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:45.958910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2e04e559-f501-459d-a122-ed7138e908c0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:45.959688 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2e04e559-f501-459d-a122-ed7138e908c0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:45.960162 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2e04e559-f501-459d-a122-ed7138e908c0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:45.974243 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-2e04e559-f501-459d-a122-ed7138e908c0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] HTTP exception thrown: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2e04e559-f501-459d-a122-ed7138e908c0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Request method failure captured: Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 HTTP/1.1 Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEb7WKhj90_SME0CJ-tXPhbghCaFx2uuZpV8pNIinQO4sRmE3lGwp0m3saWs-iZnHREH481e1y1Psq-ccvxI6HkaheiLRfSxDXJJ56zt-MIjSqwZFiNvokJ9F6bT6TTgBOJy5goqLSHGBvWLqUq5APhQbv4zQGgeA_ijsU77lwEOrs Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: 15678135086b4a5c83eefece6cb8f79a Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:03:45.975911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:03:45.977472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_15678135086b4a5c83eefece6cb8f79a", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:03:45.977472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:03:45.977472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: 15678135086b4a5c83eefece6cb8f79a Jul 25 06:03:45.977472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:03:45.977472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-AttachVolumeTestJSON-191392914-project Jul 25 06:03:45.977472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:03:45.977472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:03:45.977472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: dc8b3ecc32c14e31b55156586129a40c Jul 25 06:03:45.977472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-AttachVolumeTestJSON-191392914-project Jul 25 06:03:45.977472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:03:45.977472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. Jul 25 06:03:45.977472 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '0b706acf-4c08-4ea0-8086-3091278ad437'} Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:03:45.978695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. Jul 25 06:03:45.980145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:03:45.982030 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2e04e559-f501-459d-a122-ed7138e908c0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Returning 404 to user: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:03:45.982030 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2e04e559-f501-459d-a122-ed7138e908c0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 404 len: 111 microversion: 2.1 time: 0.029978 Jul 25 06:03:45.982030 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 398/818] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:45 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:03:45.987150 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8bce6668-233d-4bc7-b1a4-fd732463e056 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '.version_select at 0x7f9d35ff34c0>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:46.068915 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8bce6668-233d-4bc7-b1a4-fd732463e056 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253193146" status: 202 len: 0 microversion: 2.1 time: 0.086471 Jul 25 06:03:46.074374 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 421/819] 10.222.0.17 () {58 vars in 1220 bytes} [Mon Jul 25 06:03:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253193146 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:03:46.086025 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-0aed99dc-4a4e-4d90-85d4-80e07cb0ac76 req-2c0acd78-f1ff-48c7-838d-fc7016dd8c76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339de78a-2525-478a-842f-faea8fc424e2", "tag": "5f811af2-0e22-4934-ac4e-1b3da227067b"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:46.101355 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-0aed99dc-4a4e-4d90-85d4-80e07cb0ac76 req-2c0acd78-f1ff-48c7-838d-fc7016dd8c76 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:46.101802 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-0aed99dc-4a4e-4d90-85d4-80e07cb0ac76 req-2c0acd78-f1ff-48c7-838d-fc7016dd8c76 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:46.113915 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-0aed99dc-4a4e-4d90-85d4-80e07cb0ac76 req-2c0acd78-f1ff-48c7-838d-fc7016dd8c76 service nova] Creating event network-changed:5f811af2-0e22-4934-ac4e-1b3da227067b for instance 339de78a-2525-478a-842f-faea8fc424e2 on hv-cinder-85083 Jul 25 06:03:46.119315 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-0aed99dc-4a4e-4d90-85d4-80e07cb0ac76 req-2c0acd78-f1ff-48c7-838d-fc7016dd8c76 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036848 Jul 25 06:03:46.120299 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 399/820] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:46.998356 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ef11c0c4-4d12-41b6-898f-d1055ad857f8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Action: 'create', calling method: .version_select at 0x7f9d35fa5040>, body: {"keypair": {"name": "tempest-keypair-921709644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqu9tgTQRL/DEPSa1SziTlIX1m8BTAPlj7u5uYjOgdvhvfgs7RiCxz63d8RQ2QDRBzJ1ArxZtXS1L7cGN7StbzWB+fD1iTBgf65dUQ5TpfpzW4L9qwpD/o8xwbaJLc2mA=="}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:47.014739 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-ef11c0c4-4d12-41b6-898f-d1055ad857f8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Getting quotas for project 15678135086b4a5c83eefece6cb8f79a. Resources: {'key_pairs'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:03:47.018637 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-ef11c0c4-4d12-41b6-898f-d1055ad857f8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Getting quotas for user dc8b3ecc32c14e31b55156586129a40c and project 15678135086b4a5c83eefece6cb8f79a. Resources: {'key_pairs'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:03:47.086067 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ef11c0c4-4d12-41b6-898f-d1055ad857f8 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.092387 Jul 25 06:03:47.086750 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 422/821] 10.222.0.17 () {60 vars in 1158 bytes} [Mon Jul 25 06:03:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:49.214862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-641a7248-7cbd-4142-9431-14fadb4bbad9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-685964186", "imageRef": "bfffd6ef-7f99-4a99-90f3-027fe9c89821", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6caf91fe-f37c-45ab-b227-102d6cd92b3d"}], "security_groups": [{"name": "tempest-securitygroup--333460599"}], "key_name": "tempest-keypair-921709644", "user_data": "}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:49.313391 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.network.neutron [None req-641a7248-7cbd-4142-9431-14fadb4bbad9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] validate_networks() for [('6caf91fe-f37c-45ab-b227-102d6cd92b3d', None, None, None, None, None)] {{(pid=130162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:03:49.486857 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:49.676267 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-641a7248-7cbd-4142-9431-14fadb4bbad9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Flavor limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:03:49.676695 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-641a7248-7cbd-4142-9431-14fadb4bbad9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Image limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:03:49.677210 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-641a7248-7cbd-4142-9431-14fadb4bbad9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Flavor pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:03:49.677626 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-641a7248-7cbd-4142-9431-14fadb4bbad9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Image pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:03:49.678067 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-641a7248-7cbd-4142-9431-14fadb4bbad9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:03:49.687099 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-641a7248-7cbd-4142-9431-14fadb4bbad9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:49.687546 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-641a7248-7cbd-4142-9431-14fadb4bbad9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:49.690642 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-641a7248-7cbd-4142-9431-14fadb4bbad9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:49.690642 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-641a7248-7cbd-4142-9431-14fadb4bbad9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:49.705701 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-641a7248-7cbd-4142-9431-14fadb4bbad9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Getting quotas for project 15678135086b4a5c83eefece6cb8f79a. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:03:49.709810 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-641a7248-7cbd-4142-9431-14fadb4bbad9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Getting quotas for user dc8b3ecc32c14e31b55156586129a40c and project 15678135086b4a5c83eefece6cb8f79a. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:03:49.721377 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-641a7248-7cbd-4142-9431-14fadb4bbad9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Going to run 1 instances... {{(pid=130162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:03:49.723752 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-641a7248-7cbd-4142-9431-14fadb4bbad9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfffd6ef-7f99-4a99-90f3-027fe9c89821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:03:49.872870 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-641a7248-7cbd-4142-9431-14fadb4bbad9 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.663341 Jul 25 06:03:49.873502 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 400/822] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 06:03:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:03:49.885047 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d542ce8f-5002-443b-8413-944084021469 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:49.885713 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d542ce8f-5002-443b-8413-944084021469 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:49.938997 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d542ce8f-5002-443b-8413-944084021469 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:49.945766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d542ce8f-5002-443b-8413-944084021469 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1236 microversion: 2.1 time: 0.065880 Jul 25 06:03:49.947115 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 423/823] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:49 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:51.017534 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-105cfbaf-b7b7-40f4-9a9b-2951ec3929fb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:51.018155 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-105cfbaf-b7b7-40f4-9a9b-2951ec3929fb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:51.025141 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-105cfbaf-b7b7-40f4-9a9b-2951ec3929fb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:51.025592 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-105cfbaf-b7b7-40f4-9a9b-2951ec3929fb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:51.026358 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-105cfbaf-b7b7-40f4-9a9b-2951ec3929fb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:51.026826 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-105cfbaf-b7b7-40f4-9a9b-2951ec3929fb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:51.088714 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-105cfbaf-b7b7-40f4-9a9b-2951ec3929fb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:51.096693 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-105cfbaf-b7b7-40f4-9a9b-2951ec3929fb tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1232 microversion: 2.1 time: 0.137449 Jul 25 06:03:51.097246 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 401/824] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:50 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1232 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:52.113297 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-fcb95b7d-7e71-421b-9d01-d989cb9f1f08 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:52.113954 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-fcb95b7d-7e71-421b-9d01-d989cb9f1f08 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:52.120830 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fcb95b7d-7e71-421b-9d01-d989cb9f1f08 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:52.121286 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fcb95b7d-7e71-421b-9d01-d989cb9f1f08 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:52.122073 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fcb95b7d-7e71-421b-9d01-d989cb9f1f08 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:52.122550 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fcb95b7d-7e71-421b-9d01-d989cb9f1f08 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:52.200186 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-fcb95b7d-7e71-421b-9d01-d989cb9f1f08 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:52.208070 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-fcb95b7d-7e71-421b-9d01-d989cb9f1f08 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1294 microversion: 2.1 time: 0.098578 Jul 25 06:03:52.208752 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 424/825] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:52 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1294 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:53.225341 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-c4b4ca25-a1e7-4ad1-a4b3-70e7b334d018 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:53.226878 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-c4b4ca25-a1e7-4ad1-a4b3-70e7b334d018 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:53.234173 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c4b4ca25-a1e7-4ad1-a4b3-70e7b334d018 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:53.234862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c4b4ca25-a1e7-4ad1-a4b3-70e7b334d018 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:53.235805 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c4b4ca25-a1e7-4ad1-a4b3-70e7b334d018 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:53.236272 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c4b4ca25-a1e7-4ad1-a4b3-70e7b334d018 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:53.428740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-c4b4ca25-a1e7-4ad1-a4b3-70e7b334d018 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:53.436784 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-c4b4ca25-a1e7-4ad1-a4b3-70e7b334d018 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1361 microversion: 2.1 time: 0.215360 Jul 25 06:03:53.437409 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 402/826] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:53 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:53.569507 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-8644ab7e-eddb-49b8-9245-a760fc63d547 req-cf8fee62-ab96-4b36-bcd5-fb7f96b05a7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62d77f24-3139-4a33-85bb-a51141e58ce2", "tag": "3af24c18-6fc2-4b74-a3ab-afaa89b2efe0"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:53.583548 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-8644ab7e-eddb-49b8-9245-a760fc63d547 req-cf8fee62-ab96-4b36-bcd5-fb7f96b05a7a service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:53.587827 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-8644ab7e-eddb-49b8-9245-a760fc63d547 req-cf8fee62-ab96-4b36-bcd5-fb7f96b05a7a service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:53.597109 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-8644ab7e-eddb-49b8-9245-a760fc63d547 req-cf8fee62-ab96-4b36-bcd5-fb7f96b05a7a service nova] Creating event network-changed:3af24c18-6fc2-4b74-a3ab-afaa89b2efe0 for instance 62d77f24-3139-4a33-85bb-a51141e58ce2 on hv-cinder-85083 Jul 25 06:03:53.602807 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-8644ab7e-eddb-49b8-9245-a760fc63d547 req-cf8fee62-ab96-4b36-bcd5-fb7f96b05a7a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038088 Jul 25 06:03:53.603488 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 425/827] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:54.453639 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d720c93c-2170-46d8-972a-3c680d2b357e tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:54.454272 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d720c93c-2170-46d8-972a-3c680d2b357e tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:54.460684 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d720c93c-2170-46d8-972a-3c680d2b357e tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:54.461132 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d720c93c-2170-46d8-972a-3c680d2b357e tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:54.461889 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d720c93c-2170-46d8-972a-3c680d2b357e tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:54.462322 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d720c93c-2170-46d8-972a-3c680d2b357e tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:54.467105 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=100 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:54.596471 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d720c93c-2170-46d8-972a-3c680d2b357e tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:54.603918 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d720c93c-2170-46d8-972a-3c680d2b357e tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1361 microversion: 2.1 time: 0.154678 Jul 25 06:03:54.604484 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 403/828] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:54 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:55.622793 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5dcf41af-657d-411f-b70e-7b67cc643529 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:55.623488 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5dcf41af-657d-411f-b70e-7b67cc643529 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:55.629638 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5dcf41af-657d-411f-b70e-7b67cc643529 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:55.630078 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5dcf41af-657d-411f-b70e-7b67cc643529 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:55.630849 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5dcf41af-657d-411f-b70e-7b67cc643529 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:55.631281 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5dcf41af-657d-411f-b70e-7b67cc643529 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:55.761197 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5dcf41af-657d-411f-b70e-7b67cc643529 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:55.768645 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5dcf41af-657d-411f-b70e-7b67cc643529 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1361 microversion: 2.1 time: 0.151241 Jul 25 06:03:55.769209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 426/829] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:55 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:56.788375 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0bf19845-476b-48f7-8670-5b0606e172ba tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:56.788375 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0bf19845-476b-48f7-8670-5b0606e172ba tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:56.796857 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0bf19845-476b-48f7-8670-5b0606e172ba tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:56.797296 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0bf19845-476b-48f7-8670-5b0606e172ba tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:56.798054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0bf19845-476b-48f7-8670-5b0606e172ba tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:56.798493 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0bf19845-476b-48f7-8670-5b0606e172ba tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:56.924386 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0bf19845-476b-48f7-8670-5b0606e172ba tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:56.931824 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0bf19845-476b-48f7-8670-5b0606e172ba tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1361 microversion: 2.1 time: 0.149910 Jul 25 06:03:56.932388 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 404/830] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:56 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:57.948457 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f1474e13-84b4-40ed-9927-4f1cb319641a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:57.949079 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f1474e13-84b4-40ed-9927-4f1cb319641a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:57.955829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f1474e13-84b4-40ed-9927-4f1cb319641a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:57.956286 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f1474e13-84b4-40ed-9927-4f1cb319641a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:57.957073 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f1474e13-84b4-40ed-9927-4f1cb319641a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:57.957497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f1474e13-84b4-40ed-9927-4f1cb319641a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:58.084771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f1474e13-84b4-40ed-9927-4f1cb319641a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:58.092743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f1474e13-84b4-40ed-9927-4f1cb319641a tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1361 microversion: 2.1 time: 0.148078 Jul 25 06:03:58.093317 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 427/831] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:57 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:59.109980 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-db629549-8d28-40e1-8e12-f9d977be9da1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:59.110606 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-db629549-8d28-40e1-8e12-f9d977be9da1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:59.117154 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-db629549-8d28-40e1-8e12-f9d977be9da1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:59.117601 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-db629549-8d28-40e1-8e12-f9d977be9da1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:59.118353 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-db629549-8d28-40e1-8e12-f9d977be9da1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:59.118810 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-db629549-8d28-40e1-8e12-f9d977be9da1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:59.250160 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-db629549-8d28-40e1-8e12-f9d977be9da1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:59.257547 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-db629549-8d28-40e1-8e12-f9d977be9da1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1361 microversion: 2.1 time: 0.152031 Jul 25 06:03:59.258096 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 405/832] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:59 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:00.274123 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-889b910d-1322-4283-8b04-0da68ded28a0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:00.274789 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-889b910d-1322-4283-8b04-0da68ded28a0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:00.277175 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=6 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:00.277850 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:00.282586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-889b910d-1322-4283-8b04-0da68ded28a0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:00.283048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-889b910d-1322-4283-8b04-0da68ded28a0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:00.283822 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-889b910d-1322-4283-8b04-0da68ded28a0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:00.284257 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-889b910d-1322-4283-8b04-0da68ded28a0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:00.376539 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-3eee3d61-00f0-44d8-8112-5241fc9bfbcc req-6159969c-541f-409f-a79b-dc45690d493b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d77f24-3139-4a33-85bb-a51141e58ce2", "name": "network-vif-plugged", "status": "completed", "tag": "3af24c18-6fc2-4b74-a3ab-afaa89b2efe0"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:00.380057 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=2 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:00.380736 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=6 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:00.386750 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-3eee3d61-00f0-44d8-8112-5241fc9bfbcc req-6159969c-541f-409f-a79b-dc45690d493b service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:00.387274 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-3eee3d61-00f0-44d8-8112-5241fc9bfbcc req-6159969c-541f-409f-a79b-dc45690d493b service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:00.398235 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-3eee3d61-00f0-44d8-8112-5241fc9bfbcc req-6159969c-541f-409f-a79b-dc45690d493b service nova] Creating event network-vif-plugged:3af24c18-6fc2-4b74-a3ab-afaa89b2efe0 for instance 62d77f24-3139-4a33-85bb-a51141e58ce2 on hv-cinder-85083 Jul 25 06:04:00.403410 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-3eee3d61-00f0-44d8-8112-5241fc9bfbcc req-6159969c-541f-409f-a79b-dc45690d493b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031606 Jul 25 06:04:00.406995 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 406/833] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:04:00.420773 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-889b910d-1322-4283-8b04-0da68ded28a0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:00.428853 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-889b910d-1322-4283-8b04-0da68ded28a0 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1361 microversion: 2.1 time: 0.158534 Jul 25 06:04:00.429543 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 428/834] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:00 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:01.453454 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-5d502b85-648f-42a2-87bc-fdeb680b92fd tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:01.454150 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-5d502b85-648f-42a2-87bc-fdeb680b92fd tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:01.460688 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5d502b85-648f-42a2-87bc-fdeb680b92fd tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:01.461132 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5d502b85-648f-42a2-87bc-fdeb680b92fd tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:01.461884 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5d502b85-648f-42a2-87bc-fdeb680b92fd tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:01.462315 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5d502b85-648f-42a2-87bc-fdeb680b92fd tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:01.591303 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5d502b85-648f-42a2-87bc-fdeb680b92fd tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:01.598630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-5d502b85-648f-42a2-87bc-fdeb680b92fd tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1361 microversion: 2.1 time: 0.151087 Jul 25 06:04:01.599194 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 407/835] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:01 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:02.615797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d13543cf-4a94-4a82-ba6b-397eb5bf2a1f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:02.616425 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d13543cf-4a94-4a82-ba6b-397eb5bf2a1f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:02.622729 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d13543cf-4a94-4a82-ba6b-397eb5bf2a1f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:02.623189 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d13543cf-4a94-4a82-ba6b-397eb5bf2a1f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:02.623963 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d13543cf-4a94-4a82-ba6b-397eb5bf2a1f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:02.624404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d13543cf-4a94-4a82-ba6b-397eb5bf2a1f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:02.754779 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d13543cf-4a94-4a82-ba6b-397eb5bf2a1f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:02.762083 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d13543cf-4a94-4a82-ba6b-397eb5bf2a1f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1361 microversion: 2.1 time: 0.150750 Jul 25 06:04:02.762673 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 429/836] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:02 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:03.779990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-416e091c-a6eb-43d2-a654-941653e76018 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:03.781155 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-416e091c-a6eb-43d2-a654-941653e76018 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:03.787696 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-416e091c-a6eb-43d2-a654-941653e76018 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:03.788136 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-416e091c-a6eb-43d2-a654-941653e76018 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:03.788888 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-416e091c-a6eb-43d2-a654-941653e76018 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:03.789320 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-416e091c-a6eb-43d2-a654-941653e76018 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:03.915018 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-416e091c-a6eb-43d2-a654-941653e76018 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:03.922574 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-416e091c-a6eb-43d2-a654-941653e76018 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1547 microversion: 2.1 time: 0.146873 Jul 25 06:04:03.923125 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 408/837] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:03 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:03.938879 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f118071d-8831-4bac-bb95-c6ebabee9254 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:03.939381 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f118071d-8831-4bac-bb95-c6ebabee9254 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:03.945585 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f118071d-8831-4bac-bb95-c6ebabee9254 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:03.946026 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f118071d-8831-4bac-bb95-c6ebabee9254 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:03.946799 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f118071d-8831-4bac-bb95-c6ebabee9254 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:03.947233 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f118071d-8831-4bac-bb95-c6ebabee9254 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:04.023911 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f118071d-8831-4bac-bb95-c6ebabee9254 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089165 Jul 25 06:04:04.024504 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 430/838] 10.222.0.17 () {58 vars in 1274 bytes} [Mon Jul 25 06:04:03 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:04.156994 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a57370b2-da7a-4a0b-a9bf-2a11a7fc7396 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:04.157814 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a57370b2-da7a-4a0b-a9bf-2a11a7fc7396 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:04.163860 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a57370b2-da7a-4a0b-a9bf-2a11a7fc7396 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:04.164309 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a57370b2-da7a-4a0b-a9bf-2a11a7fc7396 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:04.165066 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a57370b2-da7a-4a0b-a9bf-2a11a7fc7396 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:04.165497 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a57370b2-da7a-4a0b-a9bf-2a11a7fc7396 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:04.188599 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a57370b2-da7a-4a0b-a9bf-2a11a7fc7396 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92/ips" status: 200 len: 147 microversion: 2.1 time: 0.133430 Jul 25 06:04:04.189141 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 409/839] 10.222.0.17 () {58 vars in 1247 bytes} [Mon Jul 25 06:04:04 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92/ips => generated 147 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:05.278690 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-70611f8f-1a48-4aa3-8336-ad786f004fe0 req-6f8970d6-8726-4cc1-b776-2694c0b51f69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62d77f24-3139-4a33-85bb-a51141e58ce2", "tag": "3af24c18-6fc2-4b74-a3ab-afaa89b2efe0"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:05.286680 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-70611f8f-1a48-4aa3-8336-ad786f004fe0 req-6f8970d6-8726-4cc1-b776-2694c0b51f69 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:05.287126 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-70611f8f-1a48-4aa3-8336-ad786f004fe0 req-6f8970d6-8726-4cc1-b776-2694c0b51f69 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:05.301081 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-70611f8f-1a48-4aa3-8336-ad786f004fe0 req-6f8970d6-8726-4cc1-b776-2694c0b51f69 service nova] Creating event network-changed:3af24c18-6fc2-4b74-a3ab-afaa89b2efe0 for instance 62d77f24-3139-4a33-85bb-a51141e58ce2 on hv-cinder-85083 Jul 25 06:04:05.306110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-70611f8f-1a48-4aa3-8336-ad786f004fe0 req-6f8970d6-8726-4cc1-b776-2694c0b51f69 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031533 Jul 25 06:04:05.306742 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 431/840] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:05.852885 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-aa137ba7-a2b2-4a49-a23e-320140c1a3fc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67a85fe4-5cfb-4531-b1f0-98155e4c72ed"}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:05.854018 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-aa137ba7-a2b2-4a49-a23e-320140c1a3fc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:05.860844 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aa137ba7-a2b2-4a49-a23e-320140c1a3fc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:05.861314 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aa137ba7-a2b2-4a49-a23e-320140c1a3fc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:05.862211 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aa137ba7-a2b2-4a49-a23e-320140c1a3fc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:05.862684 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aa137ba7-a2b2-4a49-a23e-320140c1a3fc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:06.625773 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-aa137ba7-a2b2-4a49-a23e-320140c1a3fc tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "POST /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.776980 Jul 25 06:04:06.626466 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 410/841] 10.222.0.17 () {60 vars in 1322 bytes} [Mon Jul 25 06:04:05 2022] POST /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92/os-volume_attachments => generated 194 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:14.106537 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8c54aee0-769c-4f37-9820-8df792346f63 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67a85fe4-5cfb-4531-b1f0-98155e4c72ed"}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:14.107764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8c54aee0-769c-4f37-9820-8df792346f63 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:14.113983 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8c54aee0-769c-4f37-9820-8df792346f63 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:14.114430 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8c54aee0-769c-4f37-9820-8df792346f63 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:14.115231 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8c54aee0-769c-4f37-9820-8df792346f63 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:14.115669 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8c54aee0-769c-4f37-9820-8df792346f63 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:14.192500 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-8c54aee0-769c-4f37-9820-8df792346f63 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] HTTP exception thrown: Invalid volume: volume 67a85fe4-5cfb-4531-b1f0-98155e4c72ed is already attached to instances: a277f58b-99c2-4b07-a838-9f45f9009f92 Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8c54aee0-769c-4f37-9820-8df792346f63 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Request method failure captured: Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: POST /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92/os-volume_attachments HTTP/1.1 Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 74 Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEaup3unl7LzCcXgiLIPWZjrIYFX_SDw7ELDXjOyj6m1AigSppJN7j_MZUlx8A8dXfMKGKjZXWqF1YnEL3IukuRzY_02IDqinPYsk5il0dKKd6-RpE31D5qPeu1-2vVhe6F2MsA703sX0YNFO-wEG6wXFh49_JEAsgi8VdOlbOfuBo Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:04:14.194215 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:04:14.195764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_488e87a8233e4e69a07cd8efba37cad7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:04:14.195764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:04:14.195764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:04:14.195764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:04:14.195764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:04:14.195764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:04:14.195764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:04:14.195764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 6dc49525e3394668b4f1610c4badc144 Jul 25 06:04:14.195764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:04:14.195764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Jul 25 06:04:14.195764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {"volumeAttachment": {"volumeId": "67a85fe4-5cfb-4531-b1f0-98155e4c72ed"}} Jul 25 06:04:14.195764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Invalid volume: volume 67a85fe4-5cfb-4531-b1f0-98155e4c72ed is already attached to instances: a277f58b-99c2-4b07-a838-9f45f9009f92 Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'server_id': 'a277f58b-99c2-4b07-a838-9f45f9009f92', 'body': {'volumeAttachment': {'volumeId': '67a85fe4-5cfb-4531-b1f0-98155e4c72ed'}}} Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 67a85fe4-5cfb-4531-b1f0-98155e4c72ed is already attached to instances: a277f58b-99c2-4b07-a838-9f45f9009f92 Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:04:14.196551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 67a85fe4-5cfb-4531-b1f0-98155e4c72ed is already attached to instances: a277f58b-99c2-4b07-a838-9f45f9009f92 Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:14.197743 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:14.199007 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:14.199007 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:04:14.199007 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:04:14.199007 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 67a85fe4-5cfb-4531-b1f0-98155e4c72ed is already attached to instances: a277f58b-99c2-4b07-a838-9f45f9009f92 Jul 25 06:04:14.199007 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:04:14.199007 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8c54aee0-769c-4f37-9820-8df792346f63 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Returning 400 to user: Invalid volume: volume 67a85fe4-5cfb-4531-b1f0-98155e4c72ed is already attached to instances: a277f58b-99c2-4b07-a838-9f45f9009f92 {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:04:14.199007 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8c54aee0-769c-4f37-9820-8df792346f63 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "POST /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094269 Jul 25 06:04:14.199007 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 432/842] 10.222.0.17 () {60 vars in 1322 bytes} [Mon Jul 25 06:04:14 2022] POST /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 06:04:14.261193 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-4b44baee-519c-43f8-8dfd-5827f9b82a85 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:14.261727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-4b44baee-519c-43f8-8dfd-5827f9b82a85 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:14.267981 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4b44baee-519c-43f8-8dfd-5827f9b82a85 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:14.268635 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4b44baee-519c-43f8-8dfd-5827f9b82a85 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:14.269397 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4b44baee-519c-43f8-8dfd-5827f9b82a85 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:14.269833 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4b44baee-519c-43f8-8dfd-5827f9b82a85 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:14.355480 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-4b44baee-519c-43f8-8dfd-5827f9b82a85 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lazy-loading 'services' on Instance uuid a277f58b-99c2-4b07-a838-9f45f9009f92 {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:04:14.576959 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-4b44baee-519c-43f8-8dfd-5827f9b82a85 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92/os-volume_attachments/67a85fe4-5cfb-4531-b1f0-98155e4c72ed" status: 202 len: 0 microversion: 2.1 time: 0.320067 Jul 25 06:04:14.577936 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 411/843] 10.222.0.17 () {58 vars in 1415 bytes} [Mon Jul 25 06:04:14 2022] DELETE /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92/os-volume_attachments/67a85fe4-5cfb-4531-b1f0-98155e4c72ed => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:04:14.588140 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-52013be3-a6d5-49c6-8885-96f2ceb2c218 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:14.589108 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-52013be3-a6d5-49c6-8885-96f2ceb2c218 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:14.595920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-52013be3-a6d5-49c6-8885-96f2ceb2c218 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:14.596363 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-52013be3-a6d5-49c6-8885-96f2ceb2c218 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:14.597123 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-52013be3-a6d5-49c6-8885-96f2ceb2c218 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:14.597580 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-52013be3-a6d5-49c6-8885-96f2ceb2c218 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:14.627468 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-52013be3-a6d5-49c6-8885-96f2ceb2c218 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043303 Jul 25 06:04:14.628010 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 433/844] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:04:14 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:15.240328 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9852a778-8c4b-4063-90eb-06b5f7e2464e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:15.240907 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-9852a778-8c4b-4063-90eb-06b5f7e2464e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:15.247044 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9852a778-8c4b-4063-90eb-06b5f7e2464e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:15.247490 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9852a778-8c4b-4063-90eb-06b5f7e2464e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:15.248246 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9852a778-8c4b-4063-90eb-06b5f7e2464e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:15.248679 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9852a778-8c4b-4063-90eb-06b5f7e2464e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:15.328673 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-9852a778-8c4b-4063-90eb-06b5f7e2464e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lazy-loading 'services' on Instance uuid d7bc67af-311c-4441-bd3e-96e8387de26e {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:04:15.526703 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-9852a778-8c4b-4063-90eb-06b5f7e2464e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/os-volume_attachments/d546ea5e-e274-471a-a2ee-48cbdff9e469" status: 202 len: 0 microversion: 2.1 time: 0.290809 Jul 25 06:04:15.527611 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 412/845] 10.222.0.17 () {58 vars in 1415 bytes} [Mon Jul 25 06:04:15 2022] DELETE /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/os-volume_attachments/d546ea5e-e274-471a-a2ee-48cbdff9e469 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:04:15.536814 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8b877038-10d0-42f5-b9ef-aa9405f0e802 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:15.537736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8b877038-10d0-42f5-b9ef-aa9405f0e802 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:15.545701 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8b877038-10d0-42f5-b9ef-aa9405f0e802 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:15.546149 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8b877038-10d0-42f5-b9ef-aa9405f0e802 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:15.546946 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8b877038-10d0-42f5-b9ef-aa9405f0e802 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:15.547380 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8b877038-10d0-42f5-b9ef-aa9405f0e802 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:15.575913 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8b877038-10d0-42f5-b9ef-aa9405f0e802 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043704 Jul 25 06:04:15.576461 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 434/846] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:04:15 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:15.642324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ea89fb20-5782-4ea3-8bcf-c20b6e4adbbd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:15.643455 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ea89fb20-5782-4ea3-8bcf-c20b6e4adbbd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:15.651910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ea89fb20-5782-4ea3-8bcf-c20b6e4adbbd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:15.652358 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ea89fb20-5782-4ea3-8bcf-c20b6e4adbbd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:15.653318 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ea89fb20-5782-4ea3-8bcf-c20b6e4adbbd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:15.653747 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ea89fb20-5782-4ea3-8bcf-c20b6e4adbbd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:15.684750 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ea89fb20-5782-4ea3-8bcf-c20b6e4adbbd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049253 Jul 25 06:04:15.685294 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 413/847] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:04:15 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:16.586577 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2f17a72c-346b-4e06-86ea-cbbfca146e89 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:16.587531 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2f17a72c-346b-4e06-86ea-cbbfca146e89 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:16.593786 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2f17a72c-346b-4e06-86ea-cbbfca146e89 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:16.594225 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2f17a72c-346b-4e06-86ea-cbbfca146e89 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:16.596081 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2f17a72c-346b-4e06-86ea-cbbfca146e89 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:16.596081 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2f17a72c-346b-4e06-86ea-cbbfca146e89 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:16.625249 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2f17a72c-346b-4e06-86ea-cbbfca146e89 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042572 Jul 25 06:04:16.625806 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 435/848] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:04:16 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:16.696397 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3a30d02c-36c7-482f-8ef0-968dd1869d16 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:16.697322 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3a30d02c-36c7-482f-8ef0-968dd1869d16 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:16.703740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3a30d02c-36c7-482f-8ef0-968dd1869d16 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:16.704189 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3a30d02c-36c7-482f-8ef0-968dd1869d16 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:16.704974 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3a30d02c-36c7-482f-8ef0-968dd1869d16 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:16.705407 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3a30d02c-36c7-482f-8ef0-968dd1869d16 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:16.732876 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3a30d02c-36c7-482f-8ef0-968dd1869d16 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040540 Jul 25 06:04:16.733665 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 414/849] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:04:16 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 06:04:16.789699 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b98950fa-3e70-4e70-b338-d2370bfb7219 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:16.790132 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b98950fa-3e70-4e70-b338-d2370bfb7219 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:16.796314 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b98950fa-3e70-4e70-b338-d2370bfb7219 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:16.796762 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b98950fa-3e70-4e70-b338-d2370bfb7219 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:16.802193 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b98950fa-3e70-4e70-b338-d2370bfb7219 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:16.802193 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b98950fa-3e70-4e70-b338-d2370bfb7219 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:16.822876 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b98950fa-3e70-4e70-b338-d2370bfb7219 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Going to try to terminate instance {{(pid=130163) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:04:17.096373 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b98950fa-3e70-4e70-b338-d2370bfb7219 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 204 len: 0 microversion: 2.1 time: 0.310218 Jul 25 06:04:17.096959 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 436/850] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:04:16 2022] DELETE /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:04:17.105137 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2f1fa053-ed95-4c58-9e30-ab0346d0aba4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:17.105829 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2f1fa053-ed95-4c58-9e30-ab0346d0aba4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:17.112416 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2f1fa053-ed95-4c58-9e30-ab0346d0aba4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:17.112853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2f1fa053-ed95-4c58-9e30-ab0346d0aba4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:17.113601 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2f1fa053-ed95-4c58-9e30-ab0346d0aba4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:17.114030 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2f1fa053-ed95-4c58-9e30-ab0346d0aba4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:17.242983 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2f1fa053-ed95-4c58-9e30-ab0346d0aba4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:17.250412 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2f1fa053-ed95-4c58-9e30-ab0346d0aba4 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1678 microversion: 2.1 time: 0.149105 Jul 25 06:04:17.251029 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 415/851] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:17 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:17.637937 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b52c2b67-e001-440b-907a-4f4684277a0e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:17.639032 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b52c2b67-e001-440b-907a-4f4684277a0e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:17.646141 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b52c2b67-e001-440b-907a-4f4684277a0e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:17.646622 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b52c2b67-e001-440b-907a-4f4684277a0e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:17.647384 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b52c2b67-e001-440b-907a-4f4684277a0e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:17.647822 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b52c2b67-e001-440b-907a-4f4684277a0e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:17.651441 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:17.675867 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b52c2b67-e001-440b-907a-4f4684277a0e tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042357 Jul 25 06:04:17.676467 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 437/852] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:04:17 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 06:04:17.753749 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-7ccea175-ce2a-425b-ade4-0b81239b9df0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:17.754250 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-7ccea175-ce2a-425b-ade4-0b81239b9df0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:17.760598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7ccea175-ce2a-425b-ade4-0b81239b9df0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:17.761039 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7ccea175-ce2a-425b-ade4-0b81239b9df0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:17.761786 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7ccea175-ce2a-425b-ade4-0b81239b9df0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:17.762216 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7ccea175-ce2a-425b-ade4-0b81239b9df0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:17.787354 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-7ccea175-ce2a-425b-ade4-0b81239b9df0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Going to try to terminate instance {{(pid=130162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:04:17.881313 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:18.046624 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-7ccea175-ce2a-425b-ade4-0b81239b9df0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 204 len: 0 microversion: 2.1 time: 0.296916 Jul 25 06:04:18.047125 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 416/853] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:04:17 2022] DELETE /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:04:18.055555 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-28ce4945-7ff4-403b-9dc8-01a86ec03227 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:18.056167 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-28ce4945-7ff4-403b-9dc8-01a86ec03227 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:18.062825 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-28ce4945-7ff4-403b-9dc8-01a86ec03227 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:18.063272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-28ce4945-7ff4-403b-9dc8-01a86ec03227 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:18.064642 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-28ce4945-7ff4-403b-9dc8-01a86ec03227 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:18.065080 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-28ce4945-7ff4-403b-9dc8-01a86ec03227 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:18.191881 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-28ce4945-7ff4-403b-9dc8-01a86ec03227 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:18.199283 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-28ce4945-7ff4-403b-9dc8-01a86ec03227 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1691 microversion: 2.1 time: 0.147611 Jul 25 06:04:18.199847 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 438/854] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:18 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:18.268385 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6b86bca3-b01e-4fa6-885b-8a78af8baa69 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:18.269116 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-6b86bca3-b01e-4fa6-885b-8a78af8baa69 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:18.275225 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6b86bca3-b01e-4fa6-885b-8a78af8baa69 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:18.275672 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6b86bca3-b01e-4fa6-885b-8a78af8baa69 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:18.276429 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6b86bca3-b01e-4fa6-885b-8a78af8baa69 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:18.276859 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6b86bca3-b01e-4fa6-885b-8a78af8baa69 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:18.410607 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-6b86bca3-b01e-4fa6-885b-8a78af8baa69 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:18.418194 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-6b86bca3-b01e-4fa6-885b-8a78af8baa69 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1678 microversion: 2.1 time: 0.154470 Jul 25 06:04:18.418789 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 417/855] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:18 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:19.216334 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a2e4dc80-1840-4de1-a87b-a732bef873d5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:19.216875 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a2e4dc80-1840-4de1-a87b-a732bef873d5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:19.223858 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a2e4dc80-1840-4de1-a87b-a732bef873d5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:19.224302 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a2e4dc80-1840-4de1-a87b-a732bef873d5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:19.225092 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a2e4dc80-1840-4de1-a87b-a732bef873d5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:19.225531 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a2e4dc80-1840-4de1-a87b-a732bef873d5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:19.355199 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a2e4dc80-1840-4de1-a87b-a732bef873d5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:19.363119 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a2e4dc80-1840-4de1-a87b-a732bef873d5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1691 microversion: 2.1 time: 0.150665 Jul 25 06:04:19.363685 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 439/856] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:19 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:19.435371 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-28cd9344-4a99-4511-bb19-0069e5fab660 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:19.436021 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-28cd9344-4a99-4511-bb19-0069e5fab660 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:19.442540 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28cd9344-4a99-4511-bb19-0069e5fab660 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:19.442992 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28cd9344-4a99-4511-bb19-0069e5fab660 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:19.443753 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28cd9344-4a99-4511-bb19-0069e5fab660 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:19.444190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28cd9344-4a99-4511-bb19-0069e5fab660 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:19.573571 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-28cd9344-4a99-4511-bb19-0069e5fab660 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:19.581381 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-28cd9344-4a99-4511-bb19-0069e5fab660 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1678 microversion: 2.1 time: 0.149867 Jul 25 06:04:19.581950 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 418/857] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:19 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:20.380800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-414ab551-8b66-4a86-be27-5af227aa2bd6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:20.381440 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-414ab551-8b66-4a86-be27-5af227aa2bd6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:20.388017 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-414ab551-8b66-4a86-be27-5af227aa2bd6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:20.388466 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-414ab551-8b66-4a86-be27-5af227aa2bd6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:20.389224 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-414ab551-8b66-4a86-be27-5af227aa2bd6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:20.389657 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-414ab551-8b66-4a86-be27-5af227aa2bd6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:20.515178 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-414ab551-8b66-4a86-be27-5af227aa2bd6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:20.522453 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-414ab551-8b66-4a86-be27-5af227aa2bd6 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1691 microversion: 2.1 time: 0.146206 Jul 25 06:04:20.523036 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 440/858] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:20 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1691 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:20.598975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a1f4f4e5-0eb6-4478-994a-7d28277f6fc3 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:20.599586 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a1f4f4e5-0eb6-4478-994a-7d28277f6fc3 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:20.601921 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:20.606828 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a1f4f4e5-0eb6-4478-994a-7d28277f6fc3 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:20.607270 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a1f4f4e5-0eb6-4478-994a-7d28277f6fc3 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:20.608026 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a1f4f4e5-0eb6-4478-994a-7d28277f6fc3 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:20.608590 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a1f4f4e5-0eb6-4478-994a-7d28277f6fc3 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:20.741408 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-a1f4f4e5-0eb6-4478-994a-7d28277f6fc3 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:20.748710 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a1f4f4e5-0eb6-4478-994a-7d28277f6fc3 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1678 microversion: 2.1 time: 0.154267 Jul 25 06:04:20.749274 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 419/859] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:20 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:21.539073 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d999be50-7411-486f-a551-a170938b00f2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:21.539681 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d999be50-7411-486f-a551-a170938b00f2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:21.546324 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d999be50-7411-486f-a551-a170938b00f2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:21.546796 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d999be50-7411-486f-a551-a170938b00f2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:21.547549 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d999be50-7411-486f-a551-a170938b00f2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:21.547979 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d999be50-7411-486f-a551-a170938b00f2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:21.672148 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d999be50-7411-486f-a551-a170938b00f2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:21.679688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d999be50-7411-486f-a551-a170938b00f2 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1691 microversion: 2.1 time: 0.144409 Jul 25 06:04:21.680276 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 441/860] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:21 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1691 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:21.766414 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8c55ad90-d338-41fb-95c9-e6d458aabd4c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:21.767020 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8c55ad90-d338-41fb-95c9-e6d458aabd4c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:21.773394 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8c55ad90-d338-41fb-95c9-e6d458aabd4c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:21.773838 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8c55ad90-d338-41fb-95c9-e6d458aabd4c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:21.774625 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8c55ad90-d338-41fb-95c9-e6d458aabd4c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:21.775060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8c55ad90-d338-41fb-95c9-e6d458aabd4c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:21.960745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8c55ad90-d338-41fb-95c9-e6d458aabd4c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:21.968229 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-8c55ad90-d338-41fb-95c9-e6d458aabd4c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1678 microversion: 2.1 time: 0.205751 Jul 25 06:04:21.968797 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 420/861] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:21 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:22.398673 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-ed4ddc50-aa17-4ce6-84ea-a0c6457d3851 req-1c4a8b8a-8628-49ab-9304-58d6da4c9bab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a277f58b-99c2-4b07-a838-9f45f9009f92", "name": "network-vif-unplugged", "status": "completed", "tag": "fa9ad9cc-f41d-4f22-aff2-361b56dc3035"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:22.408002 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-ed4ddc50-aa17-4ce6-84ea-a0c6457d3851 req-1c4a8b8a-8628-49ab-9304-58d6da4c9bab service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:22.408537 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-ed4ddc50-aa17-4ce6-84ea-a0c6457d3851 req-1c4a8b8a-8628-49ab-9304-58d6da4c9bab service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:22.420060 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-ed4ddc50-aa17-4ce6-84ea-a0c6457d3851 req-1c4a8b8a-8628-49ab-9304-58d6da4c9bab service nova] Creating event network-vif-unplugged:fa9ad9cc-f41d-4f22-aff2-361b56dc3035 for instance a277f58b-99c2-4b07-a838-9f45f9009f92 on hv-cinder-85083 Jul 25 06:04:22.429073 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-ed4ddc50-aa17-4ce6-84ea-a0c6457d3851 req-1c4a8b8a-8628-49ab-9304-58d6da4c9bab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030825 Jul 25 06:04:22.429073 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 442/862] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:04:22.697193 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-c0b621c6-5672-4b6a-8b9e-fd2e42136162 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:22.697726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-c0b621c6-5672-4b6a-8b9e-fd2e42136162 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:22.703779 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c0b621c6-5672-4b6a-8b9e-fd2e42136162 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:22.704728 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c0b621c6-5672-4b6a-8b9e-fd2e42136162 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:22.705502 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c0b621c6-5672-4b6a-8b9e-fd2e42136162 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:22.705936 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c0b621c6-5672-4b6a-8b9e-fd2e42136162 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:22.932071 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-c0b621c6-5672-4b6a-8b9e-fd2e42136162 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:22.940059 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-c0b621c6-5672-4b6a-8b9e-fd2e42136162 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1691 microversion: 2.1 time: 0.246871 Jul 25 06:04:22.940713 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 421/863] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:22 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1691 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:22.985915 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ca3a83ad-ac1a-476a-b0b8-8db52fcd43d8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:22.986553 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ca3a83ad-ac1a-476a-b0b8-8db52fcd43d8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:22.993242 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ca3a83ad-ac1a-476a-b0b8-8db52fcd43d8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:22.994600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ca3a83ad-ac1a-476a-b0b8-8db52fcd43d8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:22.994600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ca3a83ad-ac1a-476a-b0b8-8db52fcd43d8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:22.994950 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ca3a83ad-ac1a-476a-b0b8-8db52fcd43d8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:23.066108 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ca3a83ad-ac1a-476a-b0b8-8db52fcd43d8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:23.074047 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ca3a83ad-ac1a-476a-b0b8-8db52fcd43d8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1611 microversion: 2.1 time: 0.092484 Jul 25 06:04:23.074670 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 443/864] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:22 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1611 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:23.851510 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-6a6362eb-0f4c-4073-a1d3-fea3d5c4831b req-998e101d-7e7c-415d-aa9b-fa2a7959c6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a277f58b-99c2-4b07-a838-9f45f9009f92", "name": "network-vif-deleted", "tag": "fa9ad9cc-f41d-4f22-aff2-361b56dc3035"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:23.867131 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-6a6362eb-0f4c-4073-a1d3-fea3d5c4831b req-998e101d-7e7c-415d-aa9b-fa2a7959c6e5 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:23.868350 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-6a6362eb-0f4c-4073-a1d3-fea3d5c4831b req-998e101d-7e7c-415d-aa9b-fa2a7959c6e5 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:23.881264 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-6a6362eb-0f4c-4073-a1d3-fea3d5c4831b req-998e101d-7e7c-415d-aa9b-fa2a7959c6e5 service nova] Creating event network-vif-deleted:fa9ad9cc-f41d-4f22-aff2-361b56dc3035 for instance a277f58b-99c2-4b07-a838-9f45f9009f92 on hv-cinder-85083 Jul 25 06:04:23.886972 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-6a6362eb-0f4c-4073-a1d3-fea3d5c4831b req-998e101d-7e7c-415d-aa9b-fa2a7959c6e5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147804 Jul 25 06:04:23.888150 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 422/865] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:23.957020 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ec3fdd4a-bb55-47f1-a205-a5b41fded68d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:23.957810 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ec3fdd4a-bb55-47f1-a205-a5b41fded68d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:23.965529 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ec3fdd4a-bb55-47f1-a205-a5b41fded68d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:23.968362 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ec3fdd4a-bb55-47f1-a205-a5b41fded68d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:23.968362 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ec3fdd4a-bb55-47f1-a205-a5b41fded68d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:23.968362 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ec3fdd4a-bb55-47f1-a205-a5b41fded68d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:24.053074 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ec3fdd4a-bb55-47f1-a205-a5b41fded68d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:24.065356 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ec3fdd4a-bb55-47f1-a205-a5b41fded68d tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1623 microversion: 2.1 time: 0.111491 Jul 25 06:04:24.067456 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 444/866] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:23 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1623 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:24.096094 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-68f846d1-e1d1-46f8-95bf-c12bc6b28574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:24.097014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-68f846d1-e1d1-46f8-95bf-c12bc6b28574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:24.105737 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-68f846d1-e1d1-46f8-95bf-c12bc6b28574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:24.106297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-68f846d1-e1d1-46f8-95bf-c12bc6b28574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:24.107172 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-68f846d1-e1d1-46f8-95bf-c12bc6b28574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:24.107677 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-68f846d1-e1d1-46f8-95bf-c12bc6b28574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:24.142274 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-68f846d1-e1d1-46f8-95bf-c12bc6b28574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:24.143057 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-68f846d1-e1d1-46f8-95bf-c12bc6b28574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:24.143582 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-68f846d1-e1d1-46f8-95bf-c12bc6b28574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lazy-loading 'fault' on Instance uuid a277f58b-99c2-4b07-a838-9f45f9009f92 {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:04:24.187167 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-68f846d1-e1d1-46f8-95bf-c12bc6b28574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:24.202945 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-68f846d1-e1d1-46f8-95bf-c12bc6b28574 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 200 len: 1331 microversion: 2.1 time: 0.113596 Jul 25 06:04:24.203665 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 423/867] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:24 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:25.101018 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-334d9ba9-1fda-4608-a186-78630163bb36 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:25.101697 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-334d9ba9-1fda-4608-a186-78630163bb36 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:25.108348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-334d9ba9-1fda-4608-a186-78630163bb36 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:25.110258 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-334d9ba9-1fda-4608-a186-78630163bb36 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:25.110258 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-334d9ba9-1fda-4608-a186-78630163bb36 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:25.110258 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-334d9ba9-1fda-4608-a186-78630163bb36 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:25.142129 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-334d9ba9-1fda-4608-a186-78630163bb36 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:25.142723 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-334d9ba9-1fda-4608-a186-78630163bb36 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:25.143289 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.objects.instance [None req-334d9ba9-1fda-4608-a186-78630163bb36 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lazy-loading 'fault' on Instance uuid d7bc67af-311c-4441-bd3e-96e8387de26e {{(pid=130163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:04:25.190820 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-334d9ba9-1fda-4608-a186-78630163bb36 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:25.195994 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-334d9ba9-1fda-4608-a186-78630163bb36 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 200 len: 1336 microversion: 2.1 time: 0.098810 Jul 25 06:04:25.196550 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 445/868] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:25 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 1336 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:25.221092 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6bdfb4a3-f7a3-444b-9a97-021f2c947ead tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:25.221691 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-6bdfb4a3-f7a3-444b-9a97-021f2c947ead tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:25.228646 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6bdfb4a3-f7a3-444b-9a97-021f2c947ead tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:25.229086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6bdfb4a3-f7a3-444b-9a97-021f2c947ead tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:25.229836 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6bdfb4a3-f7a3-444b-9a97-021f2c947ead tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:25.230261 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6bdfb4a3-f7a3-444b-9a97-021f2c947ead tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:25.244671 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-6bdfb4a3-f7a3-444b-9a97-021f2c947ead tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] HTTP exception thrown: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6bdfb4a3-f7a3-444b-9a97-021f2c947ead tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Request method failure captured: Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 HTTP/1.1 Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEaup3unl7LzCcXgiLIPWZjrIYFX_SDw7ELDXjOyj6m1AigSppJN7j_MZUlx8A8dXfMKGKjZXWqF1YnEL3IukuRzY_02IDqinPYsk5il0dKKd6-RpE31D5qPeu1-2vVhe6F2MsA703sX0YNFO-wEG6wXFh49_JEAsgi8VdOlbOfuBo Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:04:25.246238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:04:25.247780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_488e87a8233e4e69a07cd8efba37cad7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:04:25.247780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:04:25.247780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:04:25.247780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:04:25.247780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:04:25.247780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:04:25.247780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:04:25.247780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 6dc49525e3394668b4f1610c4badc144 Jul 25 06:04:25.247780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:04:25.247780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:04:25.247780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. Jul 25 06:04:25.247780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': 'a277f58b-99c2-4b07-a838-9f45f9009f92'} Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:04:25.248894 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. Jul 25 06:04:25.250086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:25.254767 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6bdfb4a3-f7a3-444b-9a97-021f2c947ead tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Returning 404 to user: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:04:25.254767 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-6bdfb4a3-f7a3-444b-9a97-021f2c947ead tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 404 len: 111 microversion: 2.1 time: 0.030714 Jul 25 06:04:25.254767 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 424/869] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:25 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:04:25.257316 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-79f6762c-52d5-4baf-aee5-3fc211201abd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '.version_select at 0x7f9d35fa55e0>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:25.336301 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-79f6762c-52d5-4baf-aee5-3fc211201abd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-590426257" status: 202 len: 0 microversion: 2.1 time: 0.082881 Jul 25 06:04:25.336863 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 446/870] 10.222.0.17 () {58 vars in 1217 bytes} [Mon Jul 25 06:04:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-590426257 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:04:25.901848 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-e9aa2e07-a8bb-44c7-98a6-d892438df924 req-dc21e684-1f35-4a77-b839-a0b2dfe72a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7bc67af-311c-4441-bd3e-96e8387de26e", "name": "network-vif-deleted", "tag": "a31d1086-8cc8-4cdd-8ab6-2db983070eae"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:25.910558 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-e9aa2e07-a8bb-44c7-98a6-d892438df924 req-dc21e684-1f35-4a77-b839-a0b2dfe72a3c service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:25.910982 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-e9aa2e07-a8bb-44c7-98a6-d892438df924 req-dc21e684-1f35-4a77-b839-a0b2dfe72a3c service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:25.921951 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-e9aa2e07-a8bb-44c7-98a6-d892438df924 req-dc21e684-1f35-4a77-b839-a0b2dfe72a3c service nova] Creating event network-vif-deleted:a31d1086-8cc8-4cdd-8ab6-2db983070eae for instance d7bc67af-311c-4441-bd3e-96e8387de26e on hv-cinder-85083 Jul 25 06:04:25.927348 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-e9aa2e07-a8bb-44c7-98a6-d892438df924 req-dc21e684-1f35-4a77-b839-a0b2dfe72a3c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029147 Jul 25 06:04:25.927840 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 425/871] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:26.121988 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2f28cd32-4979-4b96-aced-4f26bb514143 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Action: 'create', calling method: .version_select at 0x7f9d35f4e4c0>, body: {"keypair": {"name": "tempest-keypair-991426566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2E55CvkxglPQtmrv3hmwZtj7S83qCFl/WfxTqvPOGU0SiJSXmfhNuzTVq4ytq4X8/hl9NcHIs09rfDNI7jBpgXL7CyyOMl74X69P3vP3Wf2rNFZZTyVV7INDR2zR6aUQ=="}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:26.135826 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-2f28cd32-4979-4b96-aced-4f26bb514143 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Getting quotas for project 488e87a8233e4e69a07cd8efba37cad7. Resources: {'key_pairs'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:04:26.140054 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-2f28cd32-4979-4b96-aced-4f26bb514143 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Getting quotas for user 6dc49525e3394668b4f1610c4badc144 and project 488e87a8233e4e69a07cd8efba37cad7. Resources: {'key_pairs'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:04:26.213838 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-11fec36c-8858-4e41-82a8-8108ceeb4ef1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:26.214490 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-11fec36c-8858-4e41-82a8-8108ceeb4ef1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: d7bc67af-311c-4441-bd3e-96e8387de26e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:26.221186 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-11fec36c-8858-4e41-82a8-8108ceeb4ef1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:26.221764 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-11fec36c-8858-4e41-82a8-8108ceeb4ef1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:26.222367 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-11fec36c-8858-4e41-82a8-8108ceeb4ef1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:26.222820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-11fec36c-8858-4e41-82a8-8108ceeb4ef1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:26.235590 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-11fec36c-8858-4e41-82a8-8108ceeb4ef1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] HTTP exception thrown: Instance d7bc67af-311c-4441-bd3e-96e8387de26e could not be found. Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-11fec36c-8858-4e41-82a8-8108ceeb4ef1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Request method failure captured: Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e HTTP/1.1 Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEZ4GGYvj3dFL4Uvy0H58MbEz8LS_j1xNyRrePuqYNvuonp37ZlLQzY-ecjA9G73v3nGfUkWB72NIpUwhxL4BqIVyX_Mn5ZzBP_FUiEZF7oEl0i1jsl7C4MT7_85De_hItI1_J9Ix0rEBcWjJHmdYXrs4LT93CcXorpqBHUMGlS-DY Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: d30518907b9f4939b1e8666eba12186e Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-160252649 Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:04:26.237224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:04:26.238809 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d30518907b9f4939b1e8666eba12186e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d30518907b9f4939b1e8666eba12186e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d30518907b9f4939b1e8666eba12186e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d30518907b9f4939b1e8666eba12186e", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:04:26.238809 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-ServerRescueNegativeTestJSON-160252649 Jul 25 06:04:26.238809 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: d30518907b9f4939b1e8666eba12186e Jul 25 06:04:26.238809 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-160252649 Jul 25 06:04:26.238809 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-ServerRescueNegativeTestJSON-160252649-project Jul 25 06:04:26.238809 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:04:26.238809 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:04:26.238809 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 13e5d648af294c7cbc86ccd362914728 Jul 25 06:04:26.238809 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-ServerRescueNegativeTestJSON-160252649-project Jul 25 06:04:26.238809 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:04:26.238809 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance d7bc67af-311c-4441-bd3e-96e8387de26e could not be found. Jul 25 06:04:26.238809 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': 'd7bc67af-311c-4441-bd3e-96e8387de26e'} Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7bc67af-311c-4441-bd3e-96e8387de26e could not be found. Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:04:26.240231 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7bc67af-311c-4441-bd3e-96e8387de26e could not be found. Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7bc67af-311c-4441-bd3e-96e8387de26e could not be found. Jul 25 06:04:26.241588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:26.247615 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-11fec36c-8858-4e41-82a8-8108ceeb4ef1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Returning 404 to user: Instance d7bc67af-311c-4441-bd3e-96e8387de26e could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:04:26.247615 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-11fec36c-8858-4e41-82a8-8108ceeb4ef1 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e" status: 404 len: 111 microversion: 2.1 time: 0.029014 Jul 25 06:04:26.247615 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 426/872] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:26 2022] GET /compute/v2.1/servers/d7bc67af-311c-4441-bd3e-96e8387de26e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 06:04:26.248366 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2f28cd32-4979-4b96-aced-4f26bb514143 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.123588 Jul 25 06:04:26.248366 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 447/873] 10.222.0.17 () {60 vars in 1158 bytes} [Mon Jul 25 06:04:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:26.248515 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f9fb4f6f-4b3b-46a4-a66c-f7891f8925d4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '.version_select at 0x7f9d35f3cca0>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:26.345701 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f9fb4f6f-4b3b-46a4-a66c-f7891f8925d4 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1289705386" status: 202 len: 0 microversion: 2.1 time: 0.101757 Jul 25 06:04:26.346306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 427/874] 10.222.0.17 () {58 vars in 1220 bytes} [Mon Jul 25 06:04:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1289705386 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:04:28.530526 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7c1dfd0f-161a-4f60-bff3-ab2ecd5c205f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2048664122", "imageRef": "bfffd6ef-7f99-4a99-90f3-027fe9c89821", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "805986bf-e25e-49a6-a0be-02e60deb2a2d"}], "security_groups": [{"name": "tempest-securitygroup--229409838"}], "key_name": "tempest-keypair-991426566", "user_data": "}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:28.630227 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.network.neutron [None req-7c1dfd0f-161a-4f60-bff3-ab2ecd5c205f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] validate_networks() for [('805986bf-e25e-49a6-a0be-02e60deb2a2d', None, None, None, None, None)] {{(pid=130163) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:04:29.042249 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-7c1dfd0f-161a-4f60-bff3-ab2ecd5c205f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Flavor limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:04:29.042716 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-7c1dfd0f-161a-4f60-bff3-ab2ecd5c205f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Image limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:04:29.043204 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-7c1dfd0f-161a-4f60-bff3-ab2ecd5c205f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Flavor pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:04:29.043622 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-7c1dfd0f-161a-4f60-bff3-ab2ecd5c205f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Image pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:04:29.044035 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-7c1dfd0f-161a-4f60-bff3-ab2ecd5c205f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:04:29.053239 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7c1dfd0f-161a-4f60-bff3-ab2ecd5c205f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:29.053695 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7c1dfd0f-161a-4f60-bff3-ab2ecd5c205f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:29.054566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7c1dfd0f-161a-4f60-bff3-ab2ecd5c205f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:29.054999 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7c1dfd0f-161a-4f60-bff3-ab2ecd5c205f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:29.073820 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-7c1dfd0f-161a-4f60-bff3-ab2ecd5c205f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Getting quotas for project 488e87a8233e4e69a07cd8efba37cad7. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:04:29.077764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-7c1dfd0f-161a-4f60-bff3-ab2ecd5c205f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Getting quotas for user 6dc49525e3394668b4f1610c4badc144 and project 488e87a8233e4e69a07cd8efba37cad7. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:04:29.088640 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7c1dfd0f-161a-4f60-bff3-ab2ecd5c205f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Going to run 1 instances... {{(pid=130163) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:04:29.090921 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7c1dfd0f-161a-4f60-bff3-ab2ecd5c205f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bfffd6ef-7f99-4a99-90f3-027fe9c89821',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:04:29.206658 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-7c1dfd0f-161a-4f60-bff3-ab2ecd5c205f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.680875 Jul 25 06:04:29.207244 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 448/875] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 06:04:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:04:29.217724 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-753c3629-cb6b-47a3-a909-22817bfdab76 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:29.218345 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-753c3629-cb6b-47a3-a909-22817bfdab76 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:29.273694 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-753c3629-cb6b-47a3-a909-22817bfdab76 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:29.283758 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-753c3629-cb6b-47a3-a909-22817bfdab76 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1241 microversion: 2.1 time: 0.070458 Jul 25 06:04:29.287350 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 428/876] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:29 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:29.734801 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b316bb83-d72c-4f96-bd96-056d9ac94a03 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:29.735360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b316bb83-d72c-4f96-bd96-056d9ac94a03 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:29.741584 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b316bb83-d72c-4f96-bd96-056d9ac94a03 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:29.744175 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b316bb83-d72c-4f96-bd96-056d9ac94a03 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:29.744175 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b316bb83-d72c-4f96-bd96-056d9ac94a03 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:29.744175 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b316bb83-d72c-4f96-bd96-056d9ac94a03 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:29.768564 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b316bb83-d72c-4f96-bd96-056d9ac94a03 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Going to try to terminate instance {{(pid=130163) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:04:29.983715 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2c6fdd2c-021d-46a7-b64d-5e46cda7d592 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:29.983715 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2c6fdd2c-021d-46a7-b64d-5e46cda7d592 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:29.987921 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2c6fdd2c-021d-46a7-b64d-5e46cda7d592 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:29.988365 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2c6fdd2c-021d-46a7-b64d-5e46cda7d592 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:29.989123 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2c6fdd2c-021d-46a7-b64d-5e46cda7d592 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:29.989558 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2c6fdd2c-021d-46a7-b64d-5e46cda7d592 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:30.012084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2c6fdd2c-021d-46a7-b64d-5e46cda7d592 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2/ips" status: 200 len: 151 microversion: 2.20 time: 0.147308 Jul 25 06:04:30.012625 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 429/877] 10.222.0.17 () {60 vars in 1288 bytes} [Mon Jul 25 06:04:29 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2/ips => generated 151 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 06:04:30.061760 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b316bb83-d72c-4f96-bd96-056d9ac94a03 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 204 len: 0 microversion: 2.1 time: 0.331178 Jul 25 06:04:30.062500 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 449/878] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:04:29 2022] DELETE /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:04:30.070969 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3eb837e7-8514-499b-ad85-f27aa443d5a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:30.071588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3eb837e7-8514-499b-ad85-f27aa443d5a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:30.077552 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3eb837e7-8514-499b-ad85-f27aa443d5a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:30.078003 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3eb837e7-8514-499b-ad85-f27aa443d5a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:30.078827 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3eb837e7-8514-499b-ad85-f27aa443d5a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:30.079263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3eb837e7-8514-499b-ad85-f27aa443d5a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:30.213724 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3eb837e7-8514-499b-ad85-f27aa443d5a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:30.221701 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3eb837e7-8514-499b-ad85-f27aa443d5a5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1508 microversion: 2.1 time: 0.154634 Jul 25 06:04:30.223105 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 430/879] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:30 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:30.302021 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-1b9537ca-d257-460c-bcf5-9f639df7ede6 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:30.302765 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-1b9537ca-d257-460c-bcf5-9f639df7ede6 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:30.308740 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1b9537ca-d257-460c-bcf5-9f639df7ede6 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:30.309191 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1b9537ca-d257-460c-bcf5-9f639df7ede6 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:30.309955 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1b9537ca-d257-460c-bcf5-9f639df7ede6 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:30.310385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1b9537ca-d257-460c-bcf5-9f639df7ede6 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:30.373712 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-1b9537ca-d257-460c-bcf5-9f639df7ede6 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:30.381078 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-1b9537ca-d257-460c-bcf5-9f639df7ede6 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1245 microversion: 2.1 time: 0.083834 Jul 25 06:04:30.381641 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 450/880] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:30 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:31.238879 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6440c629-a4ed-4482-856f-949058218b59 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:31.239515 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-6440c629-a4ed-4482-856f-949058218b59 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:31.245983 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6440c629-a4ed-4482-856f-949058218b59 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:31.246420 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6440c629-a4ed-4482-856f-949058218b59 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:31.247200 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6440c629-a4ed-4482-856f-949058218b59 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:31.247628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6440c629-a4ed-4482-856f-949058218b59 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:31.375136 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-6440c629-a4ed-4482-856f-949058218b59 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:31.383085 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-6440c629-a4ed-4482-856f-949058218b59 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1508 microversion: 2.1 time: 0.148110 Jul 25 06:04:31.383654 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 431/881] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:31 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:31.397613 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ff48f513-4852-4a60-b532-d8a539401e99 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:31.398259 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ff48f513-4852-4a60-b532-d8a539401e99 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:31.405078 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ff48f513-4852-4a60-b532-d8a539401e99 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:31.405522 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ff48f513-4852-4a60-b532-d8a539401e99 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:31.406286 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ff48f513-4852-4a60-b532-d8a539401e99 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:31.406746 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ff48f513-4852-4a60-b532-d8a539401e99 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:31.468361 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ff48f513-4852-4a60-b532-d8a539401e99 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:31.475810 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ff48f513-4852-4a60-b532-d8a539401e99 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1245 microversion: 2.1 time: 0.082571 Jul 25 06:04:31.476388 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 451/882] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:31 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:32.143768 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f634f2be-7df5-4a41-a5b1-bcc24089bd62 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:32.144298 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f634f2be-7df5-4a41-a5b1-bcc24089bd62 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:32.150295 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f634f2be-7df5-4a41-a5b1-bcc24089bd62 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:32.150805 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f634f2be-7df5-4a41-a5b1-bcc24089bd62 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:32.151556 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f634f2be-7df5-4a41-a5b1-bcc24089bd62 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:32.151990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f634f2be-7df5-4a41-a5b1-bcc24089bd62 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:32.174010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-f634f2be-7df5-4a41-a5b1-bcc24089bd62 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lazy-loading 'flavor' on Instance uuid 339de78a-2525-478a-842f-faea8fc424e2 {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:04:32.289856 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-38674436-9357-43b9-bb43-d3976471cd07 req-675f7af7-f952-4c63-9ba9-4f1a57aa8caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af46a4c-7081-4329-bcb1-df497104456e", "name": "network-vif-deleted", "tag": "84dfe514-aa89-4462-b8cb-4f42811b6545"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:32.298354 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-38674436-9357-43b9-bb43-d3976471cd07 req-675f7af7-f952-4c63-9ba9-4f1a57aa8caf service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:32.298841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-38674436-9357-43b9-bb43-d3976471cd07 req-675f7af7-f952-4c63-9ba9-4f1a57aa8caf service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:32.310055 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-38674436-9357-43b9-bb43-d3976471cd07 req-675f7af7-f952-4c63-9ba9-4f1a57aa8caf service nova] Creating event network-vif-deleted:84dfe514-aa89-4462-b8cb-4f42811b6545 for instance 6af46a4c-7081-4329-bcb1-df497104456e on hv-cinder-85083 Jul 25 06:04:32.315622 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-38674436-9357-43b9-bb43-d3976471cd07 req-675f7af7-f952-4c63-9ba9-4f1a57aa8caf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028665 Jul 25 06:04:32.317592 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 452/883] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:04:32.400907 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d01783cf-4ce0-4bb0-be86-800ced806ae3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:32.401648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d01783cf-4ce0-4bb0-be86-800ced806ae3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:32.408623 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d01783cf-4ce0-4bb0-be86-800ced806ae3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:32.409090 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d01783cf-4ce0-4bb0-be86-800ced806ae3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:32.410053 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d01783cf-4ce0-4bb0-be86-800ced806ae3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:32.411517 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d01783cf-4ce0-4bb0-be86-800ced806ae3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:32.480489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d01783cf-4ce0-4bb0-be86-800ced806ae3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:32.490562 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d01783cf-4ce0-4bb0-be86-800ced806ae3 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 200 len: 1466 microversion: 2.1 time: 0.094038 Jul 25 06:04:32.500472 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 453/884] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:32 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 1466 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:32.506722 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d8b6b761-5139-4b88-8e31-a0071bb292cf tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:32.507342 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d8b6b761-5139-4b88-8e31-a0071bb292cf tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:32.523308 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d8b6b761-5139-4b88-8e31-a0071bb292cf tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:32.523922 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d8b6b761-5139-4b88-8e31-a0071bb292cf tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:32.524884 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d8b6b761-5139-4b88-8e31-a0071bb292cf tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:32.525502 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d8b6b761-5139-4b88-8e31-a0071bb292cf tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:32.602395 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d8b6b761-5139-4b88-8e31-a0071bb292cf tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:32.613251 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d8b6b761-5139-4b88-8e31-a0071bb292cf tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1301 microversion: 2.1 time: 0.120300 Jul 25 06:04:32.614083 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 454/885] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:32 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1301 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:32.775092 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f634f2be-7df5-4a41-a5b1-bcc24089bd62 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "POST /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2/action" status: 202 len: 0 microversion: 2.20 time: 0.635759 Jul 25 06:04:32.776160 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 432/886] 10.222.0.17 () {62 vars in 1318 bytes} [Mon Jul 25 06:04:32 2022] POST /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2/action => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:04:32.785269 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8a437304-ce16-45f1-98cc-633a15ffacd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:32.785269 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8a437304-ce16-45f1-98cc-633a15ffacd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:32.791168 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8a437304-ce16-45f1-98cc-633a15ffacd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:32.791885 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8a437304-ce16-45f1-98cc-633a15ffacd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:32.792783 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8a437304-ce16-45f1-98cc-633a15ffacd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:32.793226 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8a437304-ce16-45f1-98cc-633a15ffacd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:32.923964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8a437304-ce16-45f1-98cc-633a15ffacd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:32.930434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:32.933565 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8a437304-ce16-45f1-98cc-633a15ffacd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:32.935098 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8a437304-ce16-45f1-98cc-633a15ffacd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:32.936374 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8a437304-ce16-45f1-98cc-633a15ffacd2 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1723 microversion: 2.20 time: 0.156414 Jul 25 06:04:32.936925 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 455/887] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:32 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:33.509597 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-5737eb5f-124b-4c97-ba99-b1e7a5396468 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:33.510439 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-5737eb5f-124b-4c97-ba99-b1e7a5396468 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 6af46a4c-7081-4329-bcb1-df497104456e] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:33.516778 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5737eb5f-124b-4c97-ba99-b1e7a5396468 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:33.517299 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5737eb5f-124b-4c97-ba99-b1e7a5396468 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:33.518778 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5737eb5f-124b-4c97-ba99-b1e7a5396468 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:33.519288 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5737eb5f-124b-4c97-ba99-b1e7a5396468 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:33.533320 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-5737eb5f-124b-4c97-ba99-b1e7a5396468 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] HTTP exception thrown: Instance 6af46a4c-7081-4329-bcb1-df497104456e could not be found. Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-5737eb5f-124b-4c97-ba99-b1e7a5396468 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Request method failure captured: Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e HTTP/1.1 Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEZ4GGYvj3dFL4Uvy0H58MbEz8LS_j1xNyRrePuqYNvuonp37ZlLQzY-ecjA9G73v3nGfUkWB72NIpUwhxL4BqIVyX_Mn5ZzBP_FUiEZF7oEl0i1jsl7C4MT7_85De_hItI1_J9Ix0rEBcWjJHmdYXrs4LT93CcXorpqBHUMGlS-DY Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: d30518907b9f4939b1e8666eba12186e Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-160252649 Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:04:33.535659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:04:33.536979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d30518907b9f4939b1e8666eba12186e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d30518907b9f4939b1e8666eba12186e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d30518907b9f4939b1e8666eba12186e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d30518907b9f4939b1e8666eba12186e", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:04:33.536979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-ServerRescueNegativeTestJSON-160252649 Jul 25 06:04:33.536979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: d30518907b9f4939b1e8666eba12186e Jul 25 06:04:33.536979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-160252649 Jul 25 06:04:33.536979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-ServerRescueNegativeTestJSON-160252649-project Jul 25 06:04:33.536979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:04:33.536979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:04:33.536979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 13e5d648af294c7cbc86ccd362914728 Jul 25 06:04:33.536979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-ServerRescueNegativeTestJSON-160252649-project Jul 25 06:04:33.536979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:04:33.536979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 6af46a4c-7081-4329-bcb1-df497104456e could not be found. Jul 25 06:04:33.536979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '6af46a4c-7081-4329-bcb1-df497104456e'} Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6af46a4c-7081-4329-bcb1-df497104456e could not be found. Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:04:33.537788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6af46a4c-7081-4329-bcb1-df497104456e could not be found. Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6af46a4c-7081-4329-bcb1-df497104456e could not be found. Jul 25 06:04:33.539038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:33.540100 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-5737eb5f-124b-4c97-ba99-b1e7a5396468 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Returning 404 to user: Instance 6af46a4c-7081-4329-bcb1-df497104456e could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:04:33.540100 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-5737eb5f-124b-4c97-ba99-b1e7a5396468 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e" status: 404 len: 111 microversion: 2.1 time: 0.032202 Jul 25 06:04:33.540100 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 433/888] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:33 2022] GET /compute/v2.1/servers/6af46a4c-7081-4329-bcb1-df497104456e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 06:04:33.551430 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c95ee3c0-aaec-4d52-9a5d-ea1a93853ff0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:33.552012 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c95ee3c0-aaec-4d52-9a5d-ea1a93853ff0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:33.559309 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c95ee3c0-aaec-4d52-9a5d-ea1a93853ff0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:33.562325 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c95ee3c0-aaec-4d52-9a5d-ea1a93853ff0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:33.562325 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c95ee3c0-aaec-4d52-9a5d-ea1a93853ff0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:33.562325 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c95ee3c0-aaec-4d52-9a5d-ea1a93853ff0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:33.589340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c95ee3c0-aaec-4d52-9a5d-ea1a93853ff0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Going to try to terminate instance {{(pid=130163) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:04:33.631419 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-80644fd8-1079-439b-a7dd-e0af7cec2b67 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:33.631955 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-80644fd8-1079-439b-a7dd-e0af7cec2b67 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:33.637946 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-80644fd8-1079-439b-a7dd-e0af7cec2b67 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:33.638428 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-80644fd8-1079-439b-a7dd-e0af7cec2b67 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:33.639175 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-80644fd8-1079-439b-a7dd-e0af7cec2b67 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:33.639599 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-80644fd8-1079-439b-a7dd-e0af7cec2b67 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:33.819702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:33.837244 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-80644fd8-1079-439b-a7dd-e0af7cec2b67 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:33.845450 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-80644fd8-1079-439b-a7dd-e0af7cec2b67 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1366 microversion: 2.1 time: 0.217855 Jul 25 06:04:33.850249 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 434/889] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:33 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:33.887008 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c95ee3c0-aaec-4d52-9a5d-ea1a93853ff0 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 204 len: 0 microversion: 2.1 time: 0.340586 Jul 25 06:04:33.887602 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 456/890] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:04:33 2022] DELETE /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:04:33.896140 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9f947eb5-b00f-4eda-a348-9bbf549a25ff tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:33.896854 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-9f947eb5-b00f-4eda-a348-9bbf549a25ff tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:33.903016 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9f947eb5-b00f-4eda-a348-9bbf549a25ff tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:33.903561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9f947eb5-b00f-4eda-a348-9bbf549a25ff tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:33.904537 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9f947eb5-b00f-4eda-a348-9bbf549a25ff tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:33.905088 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9f947eb5-b00f-4eda-a348-9bbf549a25ff tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:33.954672 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d633dace-9ac4-4379-b2a1-61c95b4a7122 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:33.955920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d633dace-9ac4-4379-b2a1-61c95b4a7122 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:33.962330 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d633dace-9ac4-4379-b2a1-61c95b4a7122 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:33.965346 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d633dace-9ac4-4379-b2a1-61c95b4a7122 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:33.965346 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d633dace-9ac4-4379-b2a1-61c95b4a7122 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:33.965346 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d633dace-9ac4-4379-b2a1-61c95b4a7122 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:34.107538 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-9f947eb5-b00f-4eda-a348-9bbf549a25ff tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:34.116843 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-9f947eb5-b00f-4eda-a348-9bbf549a25ff tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.225076 Jul 25 06:04:34.128291 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 435/891] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:33 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:34.128553 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d633dace-9ac4-4379-b2a1-61c95b4a7122 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:34.135718 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d633dace-9ac4-4379-b2a1-61c95b4a7122 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:34.137361 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d633dace-9ac4-4379-b2a1-61c95b4a7122 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:34.138718 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d633dace-9ac4-4379-b2a1-61c95b4a7122 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1723 microversion: 2.20 time: 0.188164 Jul 25 06:04:34.146545 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 457/892] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:33 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:04:34.360880 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-8c120aae-152a-4abc-bfb6-98e312a9d076 req-97d89467-4b4c-4a06-8321-36236809afe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb82501-96de-4841-add9-4628201cca46", "tag": "0b4f7f75-6cce-4690-b172-e4721dd570c6"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:34.368838 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-8c120aae-152a-4abc-bfb6-98e312a9d076 req-97d89467-4b4c-4a06-8321-36236809afe1 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:34.369292 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-8c120aae-152a-4abc-bfb6-98e312a9d076 req-97d89467-4b4c-4a06-8321-36236809afe1 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:34.387034 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-8c120aae-152a-4abc-bfb6-98e312a9d076 req-97d89467-4b4c-4a06-8321-36236809afe1 service nova] Creating event network-changed:0b4f7f75-6cce-4690-b172-e4721dd570c6 for instance 7fb82501-96de-4841-add9-4628201cca46 on hv-cinder-85083 Jul 25 06:04:34.392249 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-8c120aae-152a-4abc-bfb6-98e312a9d076 req-97d89467-4b4c-4a06-8321-36236809afe1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035807 Jul 25 06:04:34.393580 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 436/893] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:34.863774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c878a838-55a9-4d3c-a774-0265ba9e9c8e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:34.866291 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c878a838-55a9-4d3c-a774-0265ba9e9c8e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:34.871450 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c878a838-55a9-4d3c-a774-0265ba9e9c8e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:34.871836 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c878a838-55a9-4d3c-a774-0265ba9e9c8e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:34.872610 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c878a838-55a9-4d3c-a774-0265ba9e9c8e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:34.873068 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c878a838-55a9-4d3c-a774-0265ba9e9c8e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:35.000883 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-c878a838-55a9-4d3c-a774-0265ba9e9c8e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:35.008354 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c878a838-55a9-4d3c-a774-0265ba9e9c8e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1366 microversion: 2.1 time: 0.149038 Jul 25 06:04:35.008923 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 458/894] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:34 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:35.136285 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-37c6d10a-a64d-4562-a3da-b895941455d5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:35.136911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-37c6d10a-a64d-4562-a3da-b895941455d5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:35.143085 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-37c6d10a-a64d-4562-a3da-b895941455d5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:35.143531 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-37c6d10a-a64d-4562-a3da-b895941455d5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:35.144283 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-37c6d10a-a64d-4562-a3da-b895941455d5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:35.144714 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-37c6d10a-a64d-4562-a3da-b895941455d5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:35.148820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:35.156934 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-45f52e07-5547-485b-af65-c7d915c4b77a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:35.163166 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-45f52e07-5547-485b-af65-c7d915c4b77a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:35.164192 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-45f52e07-5547-485b-af65-c7d915c4b77a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:35.164631 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-45f52e07-5547-485b-af65-c7d915c4b77a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:35.165419 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-45f52e07-5547-485b-af65-c7d915c4b77a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:35.165852 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-45f52e07-5547-485b-af65-c7d915c4b77a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:35.301614 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-45f52e07-5547-485b-af65-c7d915c4b77a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:35.310046 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-45f52e07-5547-485b-af65-c7d915c4b77a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:35.311589 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-45f52e07-5547-485b-af65-c7d915c4b77a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:35.312769 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-45f52e07-5547-485b-af65-c7d915c4b77a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1723 microversion: 2.20 time: 0.159688 Jul 25 06:04:35.313329 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 459/895] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:35 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:04:35.507175 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-37c6d10a-a64d-4562-a3da-b895941455d5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:35.514431 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-37c6d10a-a64d-4562-a3da-b895941455d5 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.382963 Jul 25 06:04:35.515015 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 437/896] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:35 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:36.024465 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-14c4da01-d9fa-4691-bc3f-9be6194f4c92 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:36.025081 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-14c4da01-d9fa-4691-bc3f-9be6194f4c92 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:36.031476 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-14c4da01-d9fa-4691-bc3f-9be6194f4c92 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:36.031925 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-14c4da01-d9fa-4691-bc3f-9be6194f4c92 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:36.032686 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-14c4da01-d9fa-4691-bc3f-9be6194f4c92 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:36.033121 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-14c4da01-d9fa-4691-bc3f-9be6194f4c92 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:36.215073 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-14c4da01-d9fa-4691-bc3f-9be6194f4c92 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:36.215073 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-14c4da01-d9fa-4691-bc3f-9be6194f4c92 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1366 microversion: 2.1 time: 0.158361 Jul 25 06:04:36.215073 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 460/897] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:36 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:36.331209 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-230ea8d3-482d-4f04-86e6-9a898aa692b9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:36.331915 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-230ea8d3-482d-4f04-86e6-9a898aa692b9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:36.338870 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-230ea8d3-482d-4f04-86e6-9a898aa692b9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:36.339973 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-230ea8d3-482d-4f04-86e6-9a898aa692b9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:36.340098 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-230ea8d3-482d-4f04-86e6-9a898aa692b9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:36.340507 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-230ea8d3-482d-4f04-86e6-9a898aa692b9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:36.531689 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d2735b19-d9f3-4a28-9aaf-e0e404dcfd1a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:36.532404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d2735b19-d9f3-4a28-9aaf-e0e404dcfd1a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:36.538346 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d2735b19-d9f3-4a28-9aaf-e0e404dcfd1a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:36.538883 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d2735b19-d9f3-4a28-9aaf-e0e404dcfd1a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:36.539634 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d2735b19-d9f3-4a28-9aaf-e0e404dcfd1a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:36.540064 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d2735b19-d9f3-4a28-9aaf-e0e404dcfd1a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:36.621564 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-230ea8d3-482d-4f04-86e6-9a898aa692b9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:36.630956 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-230ea8d3-482d-4f04-86e6-9a898aa692b9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:36.632652 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-230ea8d3-482d-4f04-86e6-9a898aa692b9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:36.634077 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-230ea8d3-482d-4f04-86e6-9a898aa692b9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1723 microversion: 2.20 time: 0.306977 Jul 25 06:04:36.634856 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 438/898] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:36 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:36.673553 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d2735b19-d9f3-4a28-9aaf-e0e404dcfd1a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:36.681475 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d2735b19-d9f3-4a28-9aaf-e0e404dcfd1a tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.153637 Jul 25 06:04:36.690529 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 461/899] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:36 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:37.061564 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-32961962-8959-42f3-84a6-47c0f0c619b5 req-570ad93f-8b63-464c-b3be-a88e794fde29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0848c502-1383-407a-94d1-b92892dff9e4", "name": "network-vif-deleted", "tag": "d095699d-c625-4730-8749-c485d48d194f"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:37.069928 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-32961962-8959-42f3-84a6-47c0f0c619b5 req-570ad93f-8b63-464c-b3be-a88e794fde29 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:37.070362 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-32961962-8959-42f3-84a6-47c0f0c619b5 req-570ad93f-8b63-464c-b3be-a88e794fde29 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:37.081538 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-32961962-8959-42f3-84a6-47c0f0c619b5 req-570ad93f-8b63-464c-b3be-a88e794fde29 service nova] Creating event network-vif-deleted:d095699d-c625-4730-8749-c485d48d194f for instance 0848c502-1383-407a-94d1-b92892dff9e4 on hv-cinder-85083 Jul 25 06:04:37.086343 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-32961962-8959-42f3-84a6-47c0f0c619b5 req-570ad93f-8b63-464c-b3be-a88e794fde29 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028586 Jul 25 06:04:37.086934 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 439/900] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:37.223189 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-1b283c94-ab1e-46d6-a0f8-35a326576be6 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:37.223806 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-1b283c94-ab1e-46d6-a0f8-35a326576be6 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:37.230324 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1b283c94-ab1e-46d6-a0f8-35a326576be6 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:37.230752 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1b283c94-ab1e-46d6-a0f8-35a326576be6 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:37.231511 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1b283c94-ab1e-46d6-a0f8-35a326576be6 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:37.231951 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1b283c94-ab1e-46d6-a0f8-35a326576be6 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:37.368764 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-1b283c94-ab1e-46d6-a0f8-35a326576be6 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:37.376540 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-1b283c94-ab1e-46d6-a0f8-35a326576be6 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1366 microversion: 2.1 time: 0.157126 Jul 25 06:04:37.377709 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 462/901] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:37 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:37.653083 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2f48d89f-416d-4ba1-af0e-39e769236d57 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:37.653783 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2f48d89f-416d-4ba1-af0e-39e769236d57 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:37.660393 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2f48d89f-416d-4ba1-af0e-39e769236d57 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:37.660832 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2f48d89f-416d-4ba1-af0e-39e769236d57 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:37.661586 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2f48d89f-416d-4ba1-af0e-39e769236d57 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:37.662009 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2f48d89f-416d-4ba1-af0e-39e769236d57 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:37.699152 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2c764116-ead3-4257-b710-6a2a3df2e525 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:37.699853 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2c764116-ead3-4257-b710-6a2a3df2e525 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:37.707033 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2c764116-ead3-4257-b710-6a2a3df2e525 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:37.707646 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2c764116-ead3-4257-b710-6a2a3df2e525 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:37.708569 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2c764116-ead3-4257-b710-6a2a3df2e525 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:37.709067 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2c764116-ead3-4257-b710-6a2a3df2e525 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:37.774740 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2c764116-ead3-4257-b710-6a2a3df2e525 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5d648af294c7cbc86ccd362914728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30518907b9f4939b1e8666eba12186e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:37.782229 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2c764116-ead3-4257-b710-6a2a3df2e525 tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 200 len: 1481 microversion: 2.1 time: 0.087030 Jul 25 06:04:37.782829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 463/902] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:37 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 1481 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:37.794365 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2f48d89f-416d-4ba1-af0e-39e769236d57 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:37.803075 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2f48d89f-416d-4ba1-af0e-39e769236d57 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:37.804595 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2f48d89f-416d-4ba1-af0e-39e769236d57 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:37.805766 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2f48d89f-416d-4ba1-af0e-39e769236d57 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1723 microversion: 2.20 time: 0.157302 Jul 25 06:04:37.806568 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 440/903] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:37 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:38.393665 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-67f3d1df-bbfd-4f42-ac13-d9b31dd14bd9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:38.394286 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-67f3d1df-bbfd-4f42-ac13-d9b31dd14bd9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:38.400221 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-67f3d1df-bbfd-4f42-ac13-d9b31dd14bd9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:38.400674 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-67f3d1df-bbfd-4f42-ac13-d9b31dd14bd9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:38.401444 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-67f3d1df-bbfd-4f42-ac13-d9b31dd14bd9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:38.401882 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-67f3d1df-bbfd-4f42-ac13-d9b31dd14bd9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:38.536109 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-67f3d1df-bbfd-4f42-ac13-d9b31dd14bd9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:38.543974 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-67f3d1df-bbfd-4f42-ac13-d9b31dd14bd9 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1366 microversion: 2.1 time: 0.154596 Jul 25 06:04:38.544652 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 464/904] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:38 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:38.798479 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6929e6fd-8642-49fd-aa6a-cb70f36108cc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:38.799106 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-6929e6fd-8642-49fd-aa6a-cb70f36108cc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] [instance: 0848c502-1383-407a-94d1-b92892dff9e4] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:38.805766 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6929e6fd-8642-49fd-aa6a-cb70f36108cc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:38.806210 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6929e6fd-8642-49fd-aa6a-cb70f36108cc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:38.806991 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6929e6fd-8642-49fd-aa6a-cb70f36108cc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:38.807425 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6929e6fd-8642-49fd-aa6a-cb70f36108cc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:38.821374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-6929e6fd-8642-49fd-aa6a-cb70f36108cc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] HTTP exception thrown: Instance 0848c502-1383-407a-94d1-b92892dff9e4 could not be found. Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6929e6fd-8642-49fd-aa6a-cb70f36108cc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Request method failure captured: Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 HTTP/1.1 Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEZ4GGYvj3dFL4Uvy0H58MbEz8LS_j1xNyRrePuqYNvuonp37ZlLQzY-ecjA9G73v3nGfUkWB72NIpUwhxL4BqIVyX_Mn5ZzBP_FUiEZF7oEl0i1jsl7C4MT7_85De_hItI1_J9Ix0rEBcWjJHmdYXrs4LT93CcXorpqBHUMGlS-DY Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: d30518907b9f4939b1e8666eba12186e Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-160252649 Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:04:38.823054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:04:38.824743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d30518907b9f4939b1e8666eba12186e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d30518907b9f4939b1e8666eba12186e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d30518907b9f4939b1e8666eba12186e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d30518907b9f4939b1e8666eba12186e", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:04:38.824743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-ServerRescueNegativeTestJSON-160252649 Jul 25 06:04:38.824743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: d30518907b9f4939b1e8666eba12186e Jul 25 06:04:38.824743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-160252649 Jul 25 06:04:38.824743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-ServerRescueNegativeTestJSON-160252649-project Jul 25 06:04:38.824743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:04:38.824743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:04:38.824743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 13e5d648af294c7cbc86ccd362914728 Jul 25 06:04:38.824743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-ServerRescueNegativeTestJSON-160252649-project Jul 25 06:04:38.824743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:04:38.824743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 0848c502-1383-407a-94d1-b92892dff9e4 could not be found. Jul 25 06:04:38.824743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '0848c502-1383-407a-94d1-b92892dff9e4'} Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0848c502-1383-407a-94d1-b92892dff9e4 could not be found. Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:04:38.825566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0848c502-1383-407a-94d1-b92892dff9e4 could not be found. Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0848c502-1383-407a-94d1-b92892dff9e4 could not be found. Jul 25 06:04:38.827190 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:04:38.828673 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6929e6fd-8642-49fd-aa6a-cb70f36108cc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] Returning 404 to user: Instance 0848c502-1383-407a-94d1-b92892dff9e4 could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:04:38.828673 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-6929e6fd-8642-49fd-aa6a-cb70f36108cc tempest-ServerRescueNegativeTestJSON-160252649 tempest-ServerRescueNegativeTestJSON-160252649-project] 10.222.0.17 "GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4" status: 404 len: 111 microversion: 2.1 time: 0.029847 Jul 25 06:04:38.829400 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-352f8673-650c-43de-86bb-e8dca104ee5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:38.829515 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 441/905] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:38 2022] GET /compute/v2.1/servers/0848c502-1383-407a-94d1-b92892dff9e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:04:38.829613 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-352f8673-650c-43de-86bb-e8dca104ee5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:38.834733 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-352f8673-650c-43de-86bb-e8dca104ee5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:38.835184 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-352f8673-650c-43de-86bb-e8dca104ee5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:38.835973 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-352f8673-650c-43de-86bb-e8dca104ee5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:38.836411 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-352f8673-650c-43de-86bb-e8dca104ee5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:39.046789 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-352f8673-650c-43de-86bb-e8dca104ee5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:39.054648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-352f8673-650c-43de-86bb-e8dca104ee5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:39.056072 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-352f8673-650c-43de-86bb-e8dca104ee5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:39.057222 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-352f8673-650c-43de-86bb-e8dca104ee5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1723 microversion: 2.20 time: 0.236528 Jul 25 06:04:39.057775 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 465/906] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:38 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:04:39.560759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-bb9aa68d-f83a-4f3f-a467-3d0d2939d0dd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:39.561364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-bb9aa68d-f83a-4f3f-a467-3d0d2939d0dd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:39.563349 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=2 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:39.568753 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bb9aa68d-f83a-4f3f-a467-3d0d2939d0dd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:39.569193 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bb9aa68d-f83a-4f3f-a467-3d0d2939d0dd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:39.569995 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bb9aa68d-f83a-4f3f-a467-3d0d2939d0dd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:39.570416 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bb9aa68d-f83a-4f3f-a467-3d0d2939d0dd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:39.706837 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-bb9aa68d-f83a-4f3f-a467-3d0d2939d0dd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:39.714558 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-bb9aa68d-f83a-4f3f-a467-3d0d2939d0dd tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1366 microversion: 2.1 time: 0.157597 Jul 25 06:04:39.715355 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 442/907] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:39 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:40.075188 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6390350e-e44d-419b-a0b8-e9945cdeb03c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:40.075839 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6390350e-e44d-419b-a0b8-e9945cdeb03c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:40.077669 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=2 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:40.078346 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=10 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:40.083706 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6390350e-e44d-419b-a0b8-e9945cdeb03c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:40.086416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6390350e-e44d-419b-a0b8-e9945cdeb03c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:40.086416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6390350e-e44d-419b-a0b8-e9945cdeb03c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:40.086416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6390350e-e44d-419b-a0b8-e9945cdeb03c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:40.304539 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6390350e-e44d-419b-a0b8-e9945cdeb03c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:40.312974 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6390350e-e44d-419b-a0b8-e9945cdeb03c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:40.314498 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6390350e-e44d-419b-a0b8-e9945cdeb03c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:40.316230 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6390350e-e44d-419b-a0b8-e9945cdeb03c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1723 microversion: 2.20 time: 0.244902 Jul 25 06:04:40.316998 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 466/908] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:40 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:40.731776 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-7e46f03b-8c12-491c-a874-33faf8ebe33d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:40.732489 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-7e46f03b-8c12-491c-a874-33faf8ebe33d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:40.739593 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7e46f03b-8c12-491c-a874-33faf8ebe33d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:40.740276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7e46f03b-8c12-491c-a874-33faf8ebe33d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:40.741176 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7e46f03b-8c12-491c-a874-33faf8ebe33d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:40.742001 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7e46f03b-8c12-491c-a874-33faf8ebe33d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:40.984031 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-7e46f03b-8c12-491c-a874-33faf8ebe33d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:40.991557 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-7e46f03b-8c12-491c-a874-33faf8ebe33d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1366 microversion: 2.1 time: 0.264196 Jul 25 06:04:40.992215 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 443/909] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:40 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:41.334849 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c3dd4f19-1ac3-49af-a716-58b7f733b08c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:41.335476 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c3dd4f19-1ac3-49af-a716-58b7f733b08c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:41.342145 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c3dd4f19-1ac3-49af-a716-58b7f733b08c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:41.342649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c3dd4f19-1ac3-49af-a716-58b7f733b08c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:41.343423 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c3dd4f19-1ac3-49af-a716-58b7f733b08c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:41.343861 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c3dd4f19-1ac3-49af-a716-58b7f733b08c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:41.357561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a973c605-df40-488e-a78f-2755d8daedf3 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:41.358049 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a973c605-df40-488e-a78f-2755d8daedf3 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:41.364812 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a973c605-df40-488e-a78f-2755d8daedf3 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:41.365257 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a973c605-df40-488e-a78f-2755d8daedf3 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:41.366017 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a973c605-df40-488e-a78f-2755d8daedf3 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:41.366745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a973c605-df40-488e-a78f-2755d8daedf3 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:41.402399 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a973c605-df40-488e-a78f-2755d8daedf3 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/ips" status: 200 len: 146 microversion: 2.1 time: 0.048662 Jul 25 06:04:41.403723 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 444/910] 10.222.0.17 () {58 vars in 1247 bytes} [Mon Jul 25 06:04:41 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/ips => generated 146 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:04:41.493429 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-c3dd4f19-1ac3-49af-a716-58b7f733b08c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:41.503435 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-c3dd4f19-1ac3-49af-a716-58b7f733b08c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:41.505319 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-c3dd4f19-1ac3-49af-a716-58b7f733b08c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:41.506905 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c3dd4f19-1ac3-49af-a716-58b7f733b08c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1723 microversion: 2.20 time: 0.175641 Jul 25 06:04:41.507292 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 467/911] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:41 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:42.012029 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-384c3b60-c13a-4731-9b3e-460752bf159d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:42.012560 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-384c3b60-c13a-4731-9b3e-460752bf159d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:42.020297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-384c3b60-c13a-4731-9b3e-460752bf159d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:42.021088 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-384c3b60-c13a-4731-9b3e-460752bf159d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:42.022098 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-384c3b60-c13a-4731-9b3e-460752bf159d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:42.022807 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-384c3b60-c13a-4731-9b3e-460752bf159d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:42.165460 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-384c3b60-c13a-4731-9b3e-460752bf159d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:42.173544 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-384c3b60-c13a-4731-9b3e-460752bf159d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1366 microversion: 2.1 time: 0.165383 Jul 25 06:04:42.174113 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 445/912] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:42 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:42.525421 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f12502c4-12c2-42fa-9e54-0be18eb0c503 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:42.526028 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f12502c4-12c2-42fa-9e54-0be18eb0c503 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:42.533676 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f12502c4-12c2-42fa-9e54-0be18eb0c503 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:42.534296 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f12502c4-12c2-42fa-9e54-0be18eb0c503 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:42.535095 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f12502c4-12c2-42fa-9e54-0be18eb0c503 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:42.535649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f12502c4-12c2-42fa-9e54-0be18eb0c503 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:42.715939 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-a678c790-2ad7-4ba0-b94b-fe72673c5b22 req-7326be22-de70-4a07-97ce-d802dbbf6348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb82501-96de-4841-add9-4628201cca46", "name": "network-vif-plugged", "status": "completed", "tag": "0b4f7f75-6cce-4690-b172-e4721dd570c6"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:42.729132 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-a678c790-2ad7-4ba0-b94b-fe72673c5b22 req-7326be22-de70-4a07-97ce-d802dbbf6348 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:42.729590 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-a678c790-2ad7-4ba0-b94b-fe72673c5b22 req-7326be22-de70-4a07-97ce-d802dbbf6348 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:42.744486 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-a678c790-2ad7-4ba0-b94b-fe72673c5b22 req-7326be22-de70-4a07-97ce-d802dbbf6348 service nova] Creating event network-vif-plugged:0b4f7f75-6cce-4690-b172-e4721dd570c6 for instance 7fb82501-96de-4841-add9-4628201cca46 on hv-cinder-85083 Jul 25 06:04:42.749829 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-a678c790-2ad7-4ba0-b94b-fe72673c5b22 req-7326be22-de70-4a07-97ce-d802dbbf6348 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117790 Jul 25 06:04:42.751217 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 446/913] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:04:43.035350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f12502c4-12c2-42fa-9e54-0be18eb0c503 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:43.043801 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f12502c4-12c2-42fa-9e54-0be18eb0c503 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:43.051433 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f12502c4-12c2-42fa-9e54-0be18eb0c503 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:43.052620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f12502c4-12c2-42fa-9e54-0be18eb0c503 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1723 microversion: 2.20 time: 0.531145 Jul 25 06:04:43.053180 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 468/914] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:42 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1723 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:43.083336 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f436fb26-5ed4-4e63-8318-322f2746bde4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c8cc935-bbb9-4acf-971d-4cd5d59c92d1"}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:43.084710 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f436fb26-5ed4-4e63-8318-322f2746bde4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:43.090952 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f436fb26-5ed4-4e63-8318-322f2746bde4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:43.091398 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f436fb26-5ed4-4e63-8318-322f2746bde4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:43.092364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f436fb26-5ed4-4e63-8318-322f2746bde4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:43.092806 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f436fb26-5ed4-4e63-8318-322f2746bde4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:43.190615 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ee795fd4-bf62-4b9c-89cc-21773d252c31 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:43.191155 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ee795fd4-bf62-4b9c-89cc-21773d252c31 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:43.197246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ee795fd4-bf62-4b9c-89cc-21773d252c31 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:43.197697 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ee795fd4-bf62-4b9c-89cc-21773d252c31 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:43.198540 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ee795fd4-bf62-4b9c-89cc-21773d252c31 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:43.198980 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ee795fd4-bf62-4b9c-89cc-21773d252c31 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:43.329423 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ee795fd4-bf62-4b9c-89cc-21773d252c31 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:43.336911 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ee795fd4-bf62-4b9c-89cc-21773d252c31 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1366 microversion: 2.1 time: 0.150356 Jul 25 06:04:43.337468 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 469/915] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:43 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:44.070822 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-91bd0422-9370-4e69-843d-1be054565611 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:44.071487 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-91bd0422-9370-4e69-843d-1be054565611 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:44.077913 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-91bd0422-9370-4e69-843d-1be054565611 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:44.078367 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-91bd0422-9370-4e69-843d-1be054565611 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:44.079167 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-91bd0422-9370-4e69-843d-1be054565611 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:44.079608 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-91bd0422-9370-4e69-843d-1be054565611 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:44.218921 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-91bd0422-9370-4e69-843d-1be054565611 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:44.221124 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:44.228231 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-91bd0422-9370-4e69-843d-1be054565611 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:44.233007 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-91bd0422-9370-4e69-843d-1be054565611 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:44.233007 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-91bd0422-9370-4e69-843d-1be054565611 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1744 microversion: 2.20 time: 0.163991 Jul 25 06:04:44.233007 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 470/916] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:44 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:04:44.353443 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4a5931ff-dc3d-4cc0-a2af-b525ecf12560 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:44.355285 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4a5931ff-dc3d-4cc0-a2af-b525ecf12560 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:44.360430 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4a5931ff-dc3d-4cc0-a2af-b525ecf12560 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:44.360878 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4a5931ff-dc3d-4cc0-a2af-b525ecf12560 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:44.361643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4a5931ff-dc3d-4cc0-a2af-b525ecf12560 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:44.362652 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4a5931ff-dc3d-4cc0-a2af-b525ecf12560 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:44.492958 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4a5931ff-dc3d-4cc0-a2af-b525ecf12560 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:44.497035 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f436fb26-5ed4-4e63-8318-322f2746bde4 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "POST /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.418401 Jul 25 06:04:44.498401 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 447/917] 10.222.0.17 () {60 vars in 1322 bytes} [Mon Jul 25 06:04:43 2022] POST /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments => generated 194 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:44.505760 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4a5931ff-dc3d-4cc0-a2af-b525ecf12560 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1366 microversion: 2.1 time: 0.156489 Jul 25 06:04:44.506819 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 471/918] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:44 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:45.251026 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-291d4fb8-0afb-462e-9382-114191aabe98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:45.251724 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-291d4fb8-0afb-462e-9382-114191aabe98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:45.258727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-291d4fb8-0afb-462e-9382-114191aabe98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:45.259168 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-291d4fb8-0afb-462e-9382-114191aabe98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:45.259921 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-291d4fb8-0afb-462e-9382-114191aabe98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:45.260477 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-291d4fb8-0afb-462e-9382-114191aabe98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:45.397180 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-291d4fb8-0afb-462e-9382-114191aabe98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:45.405171 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-291d4fb8-0afb-462e-9382-114191aabe98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:45.406774 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-291d4fb8-0afb-462e-9382-114191aabe98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:45.407969 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-291d4fb8-0afb-462e-9382-114191aabe98 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1744 microversion: 2.20 time: 0.162019 Jul 25 06:04:45.408530 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 448/919] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:45 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:45.523232 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-faa7db21-e70e-4f76-bc7a-224014c23b61 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:45.524172 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-faa7db21-e70e-4f76-bc7a-224014c23b61 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:45.531254 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-faa7db21-e70e-4f76-bc7a-224014c23b61 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:45.531699 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-faa7db21-e70e-4f76-bc7a-224014c23b61 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:45.536147 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-faa7db21-e70e-4f76-bc7a-224014c23b61 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:45.536147 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-faa7db21-e70e-4f76-bc7a-224014c23b61 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:45.687424 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-faa7db21-e70e-4f76-bc7a-224014c23b61 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:45.695376 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-faa7db21-e70e-4f76-bc7a-224014c23b61 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1555 microversion: 2.1 time: 0.176225 Jul 25 06:04:45.696011 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 472/920] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:45 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:45.714978 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ad1452c7-84a0-447f-8320-7e92a83f851c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:45.715573 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ad1452c7-84a0-447f-8320-7e92a83f851c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:45.721482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ad1452c7-84a0-447f-8320-7e92a83f851c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:45.721928 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ad1452c7-84a0-447f-8320-7e92a83f851c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:45.722713 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ad1452c7-84a0-447f-8320-7e92a83f851c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:45.723146 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ad1452c7-84a0-447f-8320-7e92a83f851c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:45.799887 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ad1452c7-84a0-447f-8320-7e92a83f851c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088249 Jul 25 06:04:45.800487 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 449/921] 10.222.0.17 () {58 vars in 1274 bytes} [Mon Jul 25 06:04:45 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:46.428146 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a5867129-49bc-40cc-8aae-470f4a967a0a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:46.428896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a5867129-49bc-40cc-8aae-470f4a967a0a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:46.435760 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a5867129-49bc-40cc-8aae-470f4a967a0a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:46.436204 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a5867129-49bc-40cc-8aae-470f4a967a0a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:46.436969 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a5867129-49bc-40cc-8aae-470f4a967a0a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:46.437402 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a5867129-49bc-40cc-8aae-470f4a967a0a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:46.596750 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a5867129-49bc-40cc-8aae-470f4a967a0a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:46.606358 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a5867129-49bc-40cc-8aae-470f4a967a0a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:46.607924 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a5867129-49bc-40cc-8aae-470f4a967a0a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:46.609120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a5867129-49bc-40cc-8aae-470f4a967a0a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1744 microversion: 2.20 time: 0.185918 Jul 25 06:04:46.609675 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 473/922] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:46 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1744 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:47.089871 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-7fdb921d-765f-4661-b3b0-a87df0fbede8 req-a3c420bf-8932-47ce-8b58-d571c4f98235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb82501-96de-4841-add9-4628201cca46", "tag": "0b4f7f75-6cce-4690-b172-e4721dd570c6"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:47.098844 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-7fdb921d-765f-4661-b3b0-a87df0fbede8 req-a3c420bf-8932-47ce-8b58-d571c4f98235 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:47.099424 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-7fdb921d-765f-4661-b3b0-a87df0fbede8 req-a3c420bf-8932-47ce-8b58-d571c4f98235 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:47.110195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-7fdb921d-765f-4661-b3b0-a87df0fbede8 req-a3c420bf-8932-47ce-8b58-d571c4f98235 service nova] Creating event network-changed:0b4f7f75-6cce-4690-b172-e4721dd570c6 for instance 7fb82501-96de-4841-add9-4628201cca46 on hv-cinder-85083 Jul 25 06:04:47.115632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-7fdb921d-765f-4661-b3b0-a87df0fbede8 req-a3c420bf-8932-47ce-8b58-d571c4f98235 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030054 Jul 25 06:04:47.116222 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 450/923] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:47.632313 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a21ed61c-5142-49c8-b1d8-53aa9df2767d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:47.634162 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a21ed61c-5142-49c8-b1d8-53aa9df2767d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:47.643344 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a21ed61c-5142-49c8-b1d8-53aa9df2767d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:47.644268 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a21ed61c-5142-49c8-b1d8-53aa9df2767d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:47.645468 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a21ed61c-5142-49c8-b1d8-53aa9df2767d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:47.647639 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a21ed61c-5142-49c8-b1d8-53aa9df2767d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:47.839909 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a21ed61c-5142-49c8-b1d8-53aa9df2767d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:47.850711 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a21ed61c-5142-49c8-b1d8-53aa9df2767d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:47.852594 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a21ed61c-5142-49c8-b1d8-53aa9df2767d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:47.853996 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a21ed61c-5142-49c8-b1d8-53aa9df2767d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1739 microversion: 2.20 time: 0.229989 Jul 25 06:04:47.855090 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 474/924] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:47 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:48.878270 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3471e5d2-6fe6-4977-8312-46893c6f56d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:48.880006 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3471e5d2-6fe6-4977-8312-46893c6f56d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:48.887159 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3471e5d2-6fe6-4977-8312-46893c6f56d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:48.887994 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3471e5d2-6fe6-4977-8312-46893c6f56d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:48.888929 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3471e5d2-6fe6-4977-8312-46893c6f56d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:48.889522 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3471e5d2-6fe6-4977-8312-46893c6f56d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:49.050969 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3471e5d2-6fe6-4977-8312-46893c6f56d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:49.059455 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3471e5d2-6fe6-4977-8312-46893c6f56d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:49.061224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3471e5d2-6fe6-4977-8312-46893c6f56d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:49.062407 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3471e5d2-6fe6-4977-8312-46893c6f56d4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1739 microversion: 2.20 time: 0.189504 Jul 25 06:04:49.062982 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 451/925] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:48 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:49.519820 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-402cd594-9c0d-4c87-943e-10f236e59418 req-69d9a627-f518-41ab-bd49-4aeb2f9ca5fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339de78a-2525-478a-842f-faea8fc424e2", "name": "network-vif-plugged", "status": "completed", "tag": "5f811af2-0e22-4934-ac4e-1b3da227067b"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:49.534090 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-402cd594-9c0d-4c87-943e-10f236e59418 req-69d9a627-f518-41ab-bd49-4aeb2f9ca5fe service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:49.537886 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-402cd594-9c0d-4c87-943e-10f236e59418 req-69d9a627-f518-41ab-bd49-4aeb2f9ca5fe service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:49.547452 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-402cd594-9c0d-4c87-943e-10f236e59418 req-69d9a627-f518-41ab-bd49-4aeb2f9ca5fe service nova] Creating event network-vif-plugged:5f811af2-0e22-4934-ac4e-1b3da227067b for instance 339de78a-2525-478a-842f-faea8fc424e2 on hv-cinder-85083 Jul 25 06:04:49.554116 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-402cd594-9c0d-4c87-943e-10f236e59418 req-69d9a627-f518-41ab-bd49-4aeb2f9ca5fe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037612 Jul 25 06:04:49.555341 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 475/926] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:50.082732 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-febf6c20-98f0-434b-b9b5-c8979e94ce22 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:50.083350 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-febf6c20-98f0-434b-b9b5-c8979e94ce22 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:50.089867 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-febf6c20-98f0-434b-b9b5-c8979e94ce22 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:50.090337 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-febf6c20-98f0-434b-b9b5-c8979e94ce22 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:50.091155 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-febf6c20-98f0-434b-b9b5-c8979e94ce22 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:50.091612 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-febf6c20-98f0-434b-b9b5-c8979e94ce22 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:50.223627 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-febf6c20-98f0-434b-b9b5-c8979e94ce22 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:50.231599 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-febf6c20-98f0-434b-b9b5-c8979e94ce22 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:50.233138 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-febf6c20-98f0-434b-b9b5-c8979e94ce22 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:50.234396 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-febf6c20-98f0-434b-b9b5-c8979e94ce22 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1739 microversion: 2.20 time: 0.155694 Jul 25 06:04:50.234987 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 452/927] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:50 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:51.254046 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-31eef78b-4748-4c49-a9e5-8273ba9fbcef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:51.254704 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-31eef78b-4748-4c49-a9e5-8273ba9fbcef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:51.265362 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-31eef78b-4748-4c49-a9e5-8273ba9fbcef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:51.265820 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-31eef78b-4748-4c49-a9e5-8273ba9fbcef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:51.266625 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-31eef78b-4748-4c49-a9e5-8273ba9fbcef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:51.267110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-31eef78b-4748-4c49-a9e5-8273ba9fbcef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:51.419620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-31eef78b-4748-4c49-a9e5-8273ba9fbcef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:51.428760 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-31eef78b-4748-4c49-a9e5-8273ba9fbcef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:51.430279 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-31eef78b-4748-4c49-a9e5-8273ba9fbcef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:51.431460 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-31eef78b-4748-4c49-a9e5-8273ba9fbcef tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1739 microversion: 2.20 time: 0.182377 Jul 25 06:04:51.432013 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 476/928] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:51 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:52.449376 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3b57de30-f410-4fb2-b574-268452fe5e88 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:52.450923 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3b57de30-f410-4fb2-b574-268452fe5e88 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:52.457752 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:52.459818 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3b57de30-f410-4fb2-b574-268452fe5e88 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:52.460671 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3b57de30-f410-4fb2-b574-268452fe5e88 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:52.461668 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3b57de30-f410-4fb2-b574-268452fe5e88 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:52.463006 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3b57de30-f410-4fb2-b574-268452fe5e88 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:52.614806 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3b57de30-f410-4fb2-b574-268452fe5e88 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:52.625949 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3b57de30-f410-4fb2-b574-268452fe5e88 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:52.627952 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3b57de30-f410-4fb2-b574-268452fe5e88 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:52.629949 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3b57de30-f410-4fb2-b574-268452fe5e88 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1739 microversion: 2.20 time: 0.184785 Jul 25 06:04:52.630833 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 453/929] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:52 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:52.774809 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-15a51896-3a11-4f38-aa00-2fd47984d2f3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:52.775342 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-15a51896-3a11-4f38-aa00-2fd47984d2f3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:52.782579 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-15a51896-3a11-4f38-aa00-2fd47984d2f3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:52.783321 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-15a51896-3a11-4f38-aa00-2fd47984d2f3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:52.784160 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-15a51896-3a11-4f38-aa00-2fd47984d2f3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:52.785162 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-15a51896-3a11-4f38-aa00-2fd47984d2f3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:52.818158 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.objects.instance [None req-15a51896-3a11-4f38-aa00-2fd47984d2f3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lazy-loading 'flavor' on Instance uuid 1007f9b0-08e2-4d72-91e9-586792d0695b {{(pid=130163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:04:53.216382 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-15a51896-3a11-4f38-aa00-2fd47984d2f3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "POST /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b/action" status: 202 len: 0 microversion: 2.1 time: 0.449089 Jul 25 06:04:53.216382 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 477/930] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 06:04:52 2022] POST /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:04:53.221953 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ef53effd-3065-4f2d-827a-8cf90d08504d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:53.222377 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e135fbec-3986-458a-9422-466d8431bb03 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:53.223625 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e135fbec-3986-458a-9422-466d8431bb03 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:53.224083 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ef53effd-3065-4f2d-827a-8cf90d08504d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:53.230156 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e135fbec-3986-458a-9422-466d8431bb03 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:53.230635 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e135fbec-3986-458a-9422-466d8431bb03 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:53.231429 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e135fbec-3986-458a-9422-466d8431bb03 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:53.231866 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e135fbec-3986-458a-9422-466d8431bb03 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:53.233652 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ef53effd-3065-4f2d-827a-8cf90d08504d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:53.234101 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ef53effd-3065-4f2d-827a-8cf90d08504d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:53.234936 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ef53effd-3065-4f2d-827a-8cf90d08504d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:53.235587 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ef53effd-3065-4f2d-827a-8cf90d08504d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:53.292446 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ef53effd-3065-4f2d-827a-8cf90d08504d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074020 Jul 25 06:04:53.293312 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 454/931] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:04:53 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:53.303985 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-469106bc-26a4-4e78-b268-cf76cc5f995f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:53.305030 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-469106bc-26a4-4e78-b268-cf76cc5f995f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:53.311536 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-469106bc-26a4-4e78-b268-cf76cc5f995f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:53.312622 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-469106bc-26a4-4e78-b268-cf76cc5f995f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:53.313110 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-469106bc-26a4-4e78-b268-cf76cc5f995f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:53.313711 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-469106bc-26a4-4e78-b268-cf76cc5f995f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:53.341836 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:53.346110 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-469106bc-26a4-4e78-b268-cf76cc5f995f tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments/6c8cc935-bbb9-4acf-971d-4cd5d59c92d1" status: 200 len: 194 microversion: 2.1 time: 0.046714 Jul 25 06:04:53.346895 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 455/932] 10.222.0.17 () {58 vars in 1412 bytes} [Mon Jul 25 06:04:53 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments/6c8cc935-bbb9-4acf-971d-4cd5d59c92d1 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:04:53.386226 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e135fbec-3986-458a-9422-466d8431bb03 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:53.394458 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e135fbec-3986-458a-9422-466d8431bb03 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.176443 Jul 25 06:04:53.395056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 478/933] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:53 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:53.654870 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d7d99404-9251-410a-bef3-b60978973db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:53.655579 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d7d99404-9251-410a-bef3-b60978973db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:53.663077 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d7d99404-9251-410a-bef3-b60978973db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:53.663520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d7d99404-9251-410a-bef3-b60978973db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:53.664270 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d7d99404-9251-410a-bef3-b60978973db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:53.664699 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d7d99404-9251-410a-bef3-b60978973db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:53.807076 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d7d99404-9251-410a-bef3-b60978973db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:53.814942 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d7d99404-9251-410a-bef3-b60978973db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:53.816514 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d7d99404-9251-410a-bef3-b60978973db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:53.817684 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d7d99404-9251-410a-bef3-b60978973db4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1739 microversion: 2.20 time: 0.173782 Jul 25 06:04:53.818237 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 456/934] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:53 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:54.412324 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e2ab4e24-33ee-4b1d-9a01-c77b40d06c79 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:54.413823 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e2ab4e24-33ee-4b1d-9a01-c77b40d06c79 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:54.420768 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e2ab4e24-33ee-4b1d-9a01-c77b40d06c79 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:54.421481 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e2ab4e24-33ee-4b1d-9a01-c77b40d06c79 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:54.422334 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e2ab4e24-33ee-4b1d-9a01-c77b40d06c79 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:54.422826 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e2ab4e24-33ee-4b1d-9a01-c77b40d06c79 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:54.572631 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e2ab4e24-33ee-4b1d-9a01-c77b40d06c79 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:54.580692 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e2ab4e24-33ee-4b1d-9a01-c77b40d06c79 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.172366 Jul 25 06:04:54.582508 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 479/935] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:54 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:54.836988 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0916064b-5572-49c9-96eb-46bf2d1f8f1b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:54.837533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0916064b-5572-49c9-96eb-46bf2d1f8f1b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:54.845060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0916064b-5572-49c9-96eb-46bf2d1f8f1b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:54.851179 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0916064b-5572-49c9-96eb-46bf2d1f8f1b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:54.851179 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0916064b-5572-49c9-96eb-46bf2d1f8f1b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:54.851179 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0916064b-5572-49c9-96eb-46bf2d1f8f1b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:54.998309 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0916064b-5572-49c9-96eb-46bf2d1f8f1b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:55.008141 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0916064b-5572-49c9-96eb-46bf2d1f8f1b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:55.009761 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0916064b-5572-49c9-96eb-46bf2d1f8f1b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:55.011132 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0916064b-5572-49c9-96eb-46bf2d1f8f1b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1739 microversion: 2.20 time: 0.178959 Jul 25 06:04:55.011914 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 457/936] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:54 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:55.602795 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-96b42a6d-9f18-4020-83a9-c6438954c73a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:55.604058 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-96b42a6d-9f18-4020-83a9-c6438954c73a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:55.613269 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-96b42a6d-9f18-4020-83a9-c6438954c73a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:55.613718 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-96b42a6d-9f18-4020-83a9-c6438954c73a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:55.614504 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-96b42a6d-9f18-4020-83a9-c6438954c73a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:55.614932 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-96b42a6d-9f18-4020-83a9-c6438954c73a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:55.774509 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-96b42a6d-9f18-4020-83a9-c6438954c73a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:55.785888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-96b42a6d-9f18-4020-83a9-c6438954c73a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.190456 Jul 25 06:04:55.786665 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 480/937] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:55 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:56.029618 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2ebc5509-70fc-4c7e-8b99-b99e09ad84a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:56.031094 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2ebc5509-70fc-4c7e-8b99-b99e09ad84a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:56.038719 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2ebc5509-70fc-4c7e-8b99-b99e09ad84a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:56.039264 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2ebc5509-70fc-4c7e-8b99-b99e09ad84a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:56.040116 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2ebc5509-70fc-4c7e-8b99-b99e09ad84a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:56.040658 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2ebc5509-70fc-4c7e-8b99-b99e09ad84a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:56.201743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2ebc5509-70fc-4c7e-8b99-b99e09ad84a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:56.210907 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2ebc5509-70fc-4c7e-8b99-b99e09ad84a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:56.213041 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2ebc5509-70fc-4c7e-8b99-b99e09ad84a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:56.214460 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2ebc5509-70fc-4c7e-8b99-b99e09ad84a1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1739 microversion: 2.20 time: 0.189286 Jul 25 06:04:56.225857 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 458/938] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:56 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:56.848706 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c3fef3f7-53e8-4fe5-a068-22d16a8fa901 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:56.848706 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c3fef3f7-53e8-4fe5-a068-22d16a8fa901 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:56.848706 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c3fef3f7-53e8-4fe5-a068-22d16a8fa901 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:56.848706 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c3fef3f7-53e8-4fe5-a068-22d16a8fa901 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:56.849765 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c3fef3f7-53e8-4fe5-a068-22d16a8fa901 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:56.849765 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c3fef3f7-53e8-4fe5-a068-22d16a8fa901 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:56.962598 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-c3fef3f7-53e8-4fe5-a068-22d16a8fa901 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:56.970193 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c3fef3f7-53e8-4fe5-a068-22d16a8fa901 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.170733 Jul 25 06:04:56.970919 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 481/939] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:56 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:57.233254 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e0dc0803-9ffd-4b35-b421-c64585a1d56a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:57.233868 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e0dc0803-9ffd-4b35-b421-c64585a1d56a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:57.242063 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e0dc0803-9ffd-4b35-b421-c64585a1d56a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.242541 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e0dc0803-9ffd-4b35-b421-c64585a1d56a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:57.243355 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e0dc0803-9ffd-4b35-b421-c64585a1d56a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.243795 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e0dc0803-9ffd-4b35-b421-c64585a1d56a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:57.377584 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-92d1e23f-3689-43a2-86f3-c041f7b5ea7d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "495ebe12-519d-412b-8ded-77402f3ad8de"}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:57.379377 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-92d1e23f-3689-43a2-86f3-c041f7b5ea7d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:57.385608 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-92d1e23f-3689-43a2-86f3-c041f7b5ea7d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.385983 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-92d1e23f-3689-43a2-86f3-c041f7b5ea7d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:57.386800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-92d1e23f-3689-43a2-86f3-c041f7b5ea7d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.387491 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-92d1e23f-3689-43a2-86f3-c041f7b5ea7d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:57.417959 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e0dc0803-9ffd-4b35-b421-c64585a1d56a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:57.430087 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e0dc0803-9ffd-4b35-b421-c64585a1d56a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:57.431633 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e0dc0803-9ffd-4b35-b421-c64585a1d56a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:57.432816 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e0dc0803-9ffd-4b35-b421-c64585a1d56a tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1739 microversion: 2.20 time: 0.203535 Jul 25 06:04:57.433910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 459/940] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:57 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:57.987443 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ae0615d7-f0ab-4498-b721-850f8e2a1135 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:57.988065 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ae0615d7-f0ab-4498-b721-850f8e2a1135 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:57.994121 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ae0615d7-f0ab-4498-b721-850f8e2a1135 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.994603 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ae0615d7-f0ab-4498-b721-850f8e2a1135 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:57.995367 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ae0615d7-f0ab-4498-b721-850f8e2a1135 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.995815 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ae0615d7-f0ab-4498-b721-850f8e2a1135 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:58.125969 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ae0615d7-f0ab-4498-b721-850f8e2a1135 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:58.134031 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ae0615d7-f0ab-4498-b721-850f8e2a1135 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.150590 Jul 25 06:04:58.134646 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 460/941] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:57 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:58.205491 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-92d1e23f-3689-43a2-86f3-c041f7b5ea7d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "POST /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831634 Jul 25 06:04:58.206082 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 482/942] 10.222.0.17 () {60 vars in 1322 bytes} [Mon Jul 25 06:04:57 2022] POST /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments => generated 194 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:58.450821 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0222ec31-83aa-4754-b85d-730e4b45fde4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:58.451431 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0222ec31-83aa-4754-b85d-730e4b45fde4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:58.458098 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0222ec31-83aa-4754-b85d-730e4b45fde4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:58.458502 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0222ec31-83aa-4754-b85d-730e4b45fde4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:58.459271 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0222ec31-83aa-4754-b85d-730e4b45fde4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:58.459703 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0222ec31-83aa-4754-b85d-730e4b45fde4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:58.604365 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0222ec31-83aa-4754-b85d-730e4b45fde4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:58.613063 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0222ec31-83aa-4754-b85d-730e4b45fde4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:58.614604 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0222ec31-83aa-4754-b85d-730e4b45fde4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:58.615761 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0222ec31-83aa-4754-b85d-730e4b45fde4 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1739 microversion: 2.20 time: 0.168821 Jul 25 06:04:58.616316 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 461/943] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:58 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:59.185245 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8e0b32cb-53b4-4b17-bd00-b65d706663a9 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:59.185245 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8e0b32cb-53b4-4b17-bd00-b65d706663a9 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:59.185245 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8e0b32cb-53b4-4b17-bd00-b65d706663a9 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:59.185245 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8e0b32cb-53b4-4b17-bd00-b65d706663a9 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:59.187491 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8e0b32cb-53b4-4b17-bd00-b65d706663a9 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:59.187491 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8e0b32cb-53b4-4b17-bd00-b65d706663a9 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:59.304047 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8e0b32cb-53b4-4b17-bd00-b65d706663a9 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:59.313217 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8e0b32cb-53b4-4b17-bd00-b65d706663a9 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.165637 Jul 25 06:04:59.313789 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 483/944] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:59 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:59.637138 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1fc4a127-2c65-4086-a650-2a346870a58f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:59.637739 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1fc4a127-2c65-4086-a650-2a346870a58f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:59.644856 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1fc4a127-2c65-4086-a650-2a346870a58f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:59.645294 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1fc4a127-2c65-4086-a650-2a346870a58f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:59.646044 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1fc4a127-2c65-4086-a650-2a346870a58f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:59.646488 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1fc4a127-2c65-4086-a650-2a346870a58f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:59.772756 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1fc4a127-2c65-4086-a650-2a346870a58f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:59.780489 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1fc4a127-2c65-4086-a650-2a346870a58f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:59.781980 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1fc4a127-2c65-4086-a650-2a346870a58f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:59.783152 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1fc4a127-2c65-4086-a650-2a346870a58f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1721 microversion: 2.20 time: 0.149985 Jul 25 06:04:59.783706 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 462/945] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:59 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:00.330496 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b8192817-726d-4afb-8605-0a3b04dc558c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:00.331115 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b8192817-726d-4afb-8605-0a3b04dc558c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:00.337506 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b8192817-726d-4afb-8605-0a3b04dc558c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:00.337961 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b8192817-726d-4afb-8605-0a3b04dc558c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:00.339436 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b8192817-726d-4afb-8605-0a3b04dc558c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:00.339436 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b8192817-726d-4afb-8605-0a3b04dc558c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:00.471387 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b8192817-726d-4afb-8605-0a3b04dc558c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:00.474483 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:00.480558 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b8192817-726d-4afb-8605-0a3b04dc558c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.153839 Jul 25 06:05:00.484707 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 484/946] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:00 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:00.801158 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-4039b101-a083-4b50-9a78-e2f751f18b42 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:00.801802 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-4039b101-a083-4b50-9a78-e2f751f18b42 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:00.808397 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4039b101-a083-4b50-9a78-e2f751f18b42 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:00.808849 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4039b101-a083-4b50-9a78-e2f751f18b42 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:00.809610 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4039b101-a083-4b50-9a78-e2f751f18b42 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:00.810048 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4039b101-a083-4b50-9a78-e2f751f18b42 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:00.948079 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4039b101-a083-4b50-9a78-e2f751f18b42 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:00.955950 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4039b101-a083-4b50-9a78-e2f751f18b42 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:00.958163 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4039b101-a083-4b50-9a78-e2f751f18b42 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:00.959358 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-4039b101-a083-4b50-9a78-e2f751f18b42 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1721 microversion: 2.20 time: 0.162156 Jul 25 06:05:00.959914 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 463/947] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:00 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:01.498288 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b98a8510-af75-4435-8ee3-48a5dfafe30f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:01.498930 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b98a8510-af75-4435-8ee3-48a5dfafe30f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:01.506642 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b98a8510-af75-4435-8ee3-48a5dfafe30f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:01.507110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b98a8510-af75-4435-8ee3-48a5dfafe30f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:01.507872 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b98a8510-af75-4435-8ee3-48a5dfafe30f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:01.508280 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b98a8510-af75-4435-8ee3-48a5dfafe30f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:01.646149 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b98a8510-af75-4435-8ee3-48a5dfafe30f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:01.653586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b98a8510-af75-4435-8ee3-48a5dfafe30f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.159095 Jul 25 06:05:01.654149 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 485/948] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:01 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:01.977743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2c0d3e58-5ca1-4b3b-a049-d2d8040258ab tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:01.978360 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2c0d3e58-5ca1-4b3b-a049-d2d8040258ab tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:01.984898 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2c0d3e58-5ca1-4b3b-a049-d2d8040258ab tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:01.985348 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2c0d3e58-5ca1-4b3b-a049-d2d8040258ab tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:01.986106 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2c0d3e58-5ca1-4b3b-a049-d2d8040258ab tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:01.986571 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2c0d3e58-5ca1-4b3b-a049-d2d8040258ab tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:02.111989 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2c0d3e58-5ca1-4b3b-a049-d2d8040258ab tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:02.120497 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2c0d3e58-5ca1-4b3b-a049-d2d8040258ab tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:02.121987 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2c0d3e58-5ca1-4b3b-a049-d2d8040258ab tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:02.123163 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2c0d3e58-5ca1-4b3b-a049-d2d8040258ab tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1721 microversion: 2.20 time: 0.149389 Jul 25 06:05:02.123705 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 464/949] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:01 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:02.560394 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-f4698551-668e-45fc-af98-b24c3f18afd5 req-a9e867c6-857f-4e26-81d9-46eac22385ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339de78a-2525-478a-842f-faea8fc424e2", "name": "network-vif-unplugged", "status": "completed", "tag": "5f811af2-0e22-4934-ac4e-1b3da227067b"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:02.569375 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-f4698551-668e-45fc-af98-b24c3f18afd5 req-a9e867c6-857f-4e26-81d9-46eac22385ea service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:02.569816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-f4698551-668e-45fc-af98-b24c3f18afd5 req-a9e867c6-857f-4e26-81d9-46eac22385ea service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:02.580872 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-f4698551-668e-45fc-af98-b24c3f18afd5 req-a9e867c6-857f-4e26-81d9-46eac22385ea service nova] Creating event network-vif-unplugged:5f811af2-0e22-4934-ac4e-1b3da227067b for instance 339de78a-2525-478a-842f-faea8fc424e2 on hv-cinder-85083 Jul 25 06:05:02.589708 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-f4698551-668e-45fc-af98-b24c3f18afd5 req-a9e867c6-857f-4e26-81d9-46eac22385ea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032923 Jul 25 06:05:02.594042 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 486/950] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:02.670762 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-bdb9716c-f9a6-4ac5-8a46-2c84c2e791b1 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:02.671409 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-bdb9716c-f9a6-4ac5-8a46-2c84c2e791b1 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:02.677837 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bdb9716c-f9a6-4ac5-8a46-2c84c2e791b1 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:02.678346 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bdb9716c-f9a6-4ac5-8a46-2c84c2e791b1 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:02.679107 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bdb9716c-f9a6-4ac5-8a46-2c84c2e791b1 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:02.679546 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-bdb9716c-f9a6-4ac5-8a46-2c84c2e791b1 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:02.814429 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-bdb9716c-f9a6-4ac5-8a46-2c84c2e791b1 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:02.823732 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-bdb9716c-f9a6-4ac5-8a46-2c84c2e791b1 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.156885 Jul 25 06:05:02.824662 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 465/951] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:02 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:03.141478 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2502e5a5-61b4-4475-a57d-a115c2038f0f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:03.142260 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2502e5a5-61b4-4475-a57d-a115c2038f0f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:03.148653 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2502e5a5-61b4-4475-a57d-a115c2038f0f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:03.149100 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2502e5a5-61b4-4475-a57d-a115c2038f0f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:03.149867 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2502e5a5-61b4-4475-a57d-a115c2038f0f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:03.150302 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2502e5a5-61b4-4475-a57d-a115c2038f0f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:03.292751 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2502e5a5-61b4-4475-a57d-a115c2038f0f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:03.301508 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2502e5a5-61b4-4475-a57d-a115c2038f0f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:03.303161 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2502e5a5-61b4-4475-a57d-a115c2038f0f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:03.304313 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2502e5a5-61b4-4475-a57d-a115c2038f0f tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1724 microversion: 2.20 time: 0.167148 Jul 25 06:05:03.304865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 487/952] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:03 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:03.325235 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e1c9d235-7d1e-4edf-acf9-ad3f1355056c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d525df17-9fb4-4d30-b4e9-529e5b62c2c0"}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:03.326908 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e1c9d235-7d1e-4edf-acf9-ad3f1355056c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:03.333500 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e1c9d235-7d1e-4edf-acf9-ad3f1355056c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:03.333981 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e1c9d235-7d1e-4edf-acf9-ad3f1355056c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:03.334779 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e1c9d235-7d1e-4edf-acf9-ad3f1355056c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:03.335219 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e1c9d235-7d1e-4edf-acf9-ad3f1355056c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:03.842543 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-64d58a77-dd33-4b6d-bb30-7ef87a47cfd0 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:03.843175 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-64d58a77-dd33-4b6d-bb30-7ef87a47cfd0 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:03.849585 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-64d58a77-dd33-4b6d-bb30-7ef87a47cfd0 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:03.850024 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-64d58a77-dd33-4b6d-bb30-7ef87a47cfd0 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:03.850809 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-64d58a77-dd33-4b6d-bb30-7ef87a47cfd0 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:03.851240 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-64d58a77-dd33-4b6d-bb30-7ef87a47cfd0 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:03.985367 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-64d58a77-dd33-4b6d-bb30-7ef87a47cfd0 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:03.993325 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-64d58a77-dd33-4b6d-bb30-7ef87a47cfd0 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.154628 Jul 25 06:05:03.993905 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 488/953] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:03 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:04.277971 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e1c9d235-7d1e-4edf-acf9-ad3f1355056c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "POST /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.957495 Jul 25 06:05:04.278611 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 466/954] 10.222.0.17 () {62 vars in 1363 bytes} [Mon Jul 25 06:05:03 2022] POST /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2/os-volume_attachments => generated 188 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 06:05:04.395515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-565ee448-bb45-4b7a-ba76-02a5f5715c26 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:04.396001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-565ee448-bb45-4b7a-ba76-02a5f5715c26 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:04.401873 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-565ee448-bb45-4b7a-ba76-02a5f5715c26 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:04.402322 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-565ee448-bb45-4b7a-ba76-02a5f5715c26 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:04.403112 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-565ee448-bb45-4b7a-ba76-02a5f5715c26 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:04.403551 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-565ee448-bb45-4b7a-ba76-02a5f5715c26 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:05.010333 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-beff20ae-fb7d-407d-a7a9-7ab326f0a234 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:05.010987 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-beff20ae-fb7d-407d-a7a9-7ab326f0a234 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:05.019155 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-beff20ae-fb7d-407d-a7a9-7ab326f0a234 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:05.019155 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-beff20ae-fb7d-407d-a7a9-7ab326f0a234 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:05.019155 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-beff20ae-fb7d-407d-a7a9-7ab326f0a234 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:05.019591 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-beff20ae-fb7d-407d-a7a9-7ab326f0a234 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:05.152925 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-beff20ae-fb7d-407d-a7a9-7ab326f0a234 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:05.160493 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-beff20ae-fb7d-407d-a7a9-7ab326f0a234 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.154037 Jul 25 06:05:05.161054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 467/955] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:05 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:05:05.274035 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-565ee448-bb45-4b7a-ba76-02a5f5715c26 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "DELETE /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2/os-volume_attachments/d525df17-9fb4-4d30-b4e9-529e5b62c2c0" status: 202 len: 0 microversion: 2.20 time: 0.882805 Jul 25 06:05:05.274640 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 489/956] 10.222.0.17 () {60 vars in 1456 bytes} [Mon Jul 25 06:05:04 2022] DELETE /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2/os-volume_attachments/d525df17-9fb4-4d30-b4e9-529e5b62c2c0 => generated 0 bytes in 884 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:05:05.342967 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-c927edc4-994e-4c9f-a8b9-9fcfcfab7bc7 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:05.343762 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-c927edc4-994e-4c9f-a8b9-9fcfcfab7bc7 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:05.350191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c927edc4-994e-4c9f-a8b9-9fcfcfab7bc7 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:05.350677 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c927edc4-994e-4c9f-a8b9-9fcfcfab7bc7 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:05.351447 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c927edc4-994e-4c9f-a8b9-9fcfcfab7bc7 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:05.351882 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c927edc4-994e-4c9f-a8b9-9fcfcfab7bc7 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:05.461750 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:05.533676 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-c927edc4-994e-4c9f-a8b9-9fcfcfab7bc7 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "POST /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2/action" status: 202 len: 0 microversion: 2.20 time: 0.194895 Jul 25 06:05:05.534214 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 468/957] 10.222.0.17 () {62 vars in 1318 bytes} [Mon Jul 25 06:05:05 2022] POST /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:05:05.543143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-cf9a3e9d-85a1-42fb-9c73-87e48a73439c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:05.543750 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-cf9a3e9d-85a1-42fb-9c73-87e48a73439c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:05.546910 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:05.550883 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-cf9a3e9d-85a1-42fb-9c73-87e48a73439c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:05.551327 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-cf9a3e9d-85a1-42fb-9c73-87e48a73439c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:05.552091 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-cf9a3e9d-85a1-42fb-9c73-87e48a73439c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:05.552522 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-cf9a3e9d-85a1-42fb-9c73-87e48a73439c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:05.693926 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-cf9a3e9d-85a1-42fb-9c73-87e48a73439c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:05.701798 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-cf9a3e9d-85a1-42fb-9c73-87e48a73439c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:05.703339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-cf9a3e9d-85a1-42fb-9c73-87e48a73439c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:05.704470 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-cf9a3e9d-85a1-42fb-9c73-87e48a73439c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1672 microversion: 2.20 time: 0.165612 Jul 25 06:05:05.705010 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 490/958] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:05 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:06.178547 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-65339e1e-4269-4233-9a3c-577a89802383 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:06.179088 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-65339e1e-4269-4233-9a3c-577a89802383 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:06.186170 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-65339e1e-4269-4233-9a3c-577a89802383 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:06.186693 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-65339e1e-4269-4233-9a3c-577a89802383 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:06.187446 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-65339e1e-4269-4233-9a3c-577a89802383 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:06.187871 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-65339e1e-4269-4233-9a3c-577a89802383 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:06.320107 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-65339e1e-4269-4233-9a3c-577a89802383 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:06.327646 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-65339e1e-4269-4233-9a3c-577a89802383 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.153553 Jul 25 06:05:06.328240 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 469/959] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:06 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:06.721715 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-0fac2b07-4dbb-42f8-ab5e-d1b2425fe7fe tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:06.731555 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-0fac2b07-4dbb-42f8-ab5e-d1b2425fe7fe tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:06.731555 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0fac2b07-4dbb-42f8-ab5e-d1b2425fe7fe tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:06.731555 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0fac2b07-4dbb-42f8-ab5e-d1b2425fe7fe tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:06.731555 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0fac2b07-4dbb-42f8-ab5e-d1b2425fe7fe tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:06.732160 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0fac2b07-4dbb-42f8-ab5e-d1b2425fe7fe tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:06.761269 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1ab8d83b-196a-49d7-b285-9dbf247951f6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:06.762257 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1ab8d83b-196a-49d7-b285-9dbf247951f6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:06.768474 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1ab8d83b-196a-49d7-b285-9dbf247951f6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:06.768864 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1ab8d83b-196a-49d7-b285-9dbf247951f6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:06.769629 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1ab8d83b-196a-49d7-b285-9dbf247951f6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:06.770068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1ab8d83b-196a-49d7-b285-9dbf247951f6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:06.800940 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1ab8d83b-196a-49d7-b285-9dbf247951f6 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042953 Jul 25 06:05:06.801519 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 470/960] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:06 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:05:06.863592 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-0fac2b07-4dbb-42f8-ab5e-d1b2425fe7fe tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:06.871593 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-0fac2b07-4dbb-42f8-ab5e-d1b2425fe7fe tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:06.873095 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-0fac2b07-4dbb-42f8-ab5e-d1b2425fe7fe tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:06.874246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-0fac2b07-4dbb-42f8-ab5e-d1b2425fe7fe tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1672 microversion: 2.20 time: 0.156495 Jul 25 06:05:06.874831 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 491/961] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:06 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:06.916273 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6284b7f7-b0ee-4325-b9e4-bd5a33958245 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:06.916769 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-6284b7f7-b0ee-4325-b9e4-bd5a33958245 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:06.923264 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6284b7f7-b0ee-4325-b9e4-bd5a33958245 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:06.923710 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6284b7f7-b0ee-4325-b9e4-bd5a33958245 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:06.924484 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6284b7f7-b0ee-4325-b9e4-bd5a33958245 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:06.925498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6284b7f7-b0ee-4325-b9e4-bd5a33958245 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:06.954762 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-6284b7f7-b0ee-4325-b9e4-bd5a33958245 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments/6c8cc935-bbb9-4acf-971d-4cd5d59c92d1" status: 200 len: 194 microversion: 2.1 time: 0.042414 Jul 25 06:05:06.955399 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 471/962] 10.222.0.17 () {58 vars in 1412 bytes} [Mon Jul 25 06:05:06 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments/6c8cc935-bbb9-4acf-971d-4cd5d59c92d1 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:06.965445 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6f10e4fc-aa5d-4762-98b8-016a712a5acc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:06.965941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6f10e4fc-aa5d-4762-98b8-016a712a5acc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:06.971881 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6f10e4fc-aa5d-4762-98b8-016a712a5acc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:06.972326 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6f10e4fc-aa5d-4762-98b8-016a712a5acc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:06.973082 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6f10e4fc-aa5d-4762-98b8-016a712a5acc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:06.973518 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6f10e4fc-aa5d-4762-98b8-016a712a5acc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:07.053722 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.objects.instance [None req-6f10e4fc-aa5d-4762-98b8-016a712a5acc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lazy-loading 'services' on Instance uuid 62d77f24-3139-4a33-85bb-a51141e58ce2 {{(pid=130163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:05:07.341175 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6f10e4fc-aa5d-4762-98b8-016a712a5acc tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "DELETE /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments/6c8cc935-bbb9-4acf-971d-4cd5d59c92d1" status: 202 len: 0 microversion: 2.1 time: 0.379251 Jul 25 06:05:07.341683 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 492/963] 10.222.0.17 () {58 vars in 1415 bytes} [Mon Jul 25 06:05:06 2022] DELETE /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments/6c8cc935-bbb9-4acf-971d-4cd5d59c92d1 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:05:07.345171 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d8cd2a07-2626-4023-a2bb-e7848683217f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:07.345784 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d8cd2a07-2626-4023-a2bb-e7848683217f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:07.352828 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d8cd2a07-2626-4023-a2bb-e7848683217f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:07.353278 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d8cd2a07-2626-4023-a2bb-e7848683217f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:07.354039 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d8cd2a07-2626-4023-a2bb-e7848683217f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:07.354487 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d8cd2a07-2626-4023-a2bb-e7848683217f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:07.489774 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d8cd2a07-2626-4023-a2bb-e7848683217f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:07.497098 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d8cd2a07-2626-4023-a2bb-e7848683217f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.155759 Jul 25 06:05:07.497657 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 472/964] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:07 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:07.893477 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3ab9d57a-48c7-4edb-949b-68183d2d7209 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:07.894171 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-3ab9d57a-48c7-4edb-949b-68183d2d7209 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:07.900956 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3ab9d57a-48c7-4edb-949b-68183d2d7209 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:07.901398 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3ab9d57a-48c7-4edb-949b-68183d2d7209 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:07.902182 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3ab9d57a-48c7-4edb-949b-68183d2d7209 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:07.902644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3ab9d57a-48c7-4edb-949b-68183d2d7209 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:08.031823 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3ab9d57a-48c7-4edb-949b-68183d2d7209 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:08.041391 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3ab9d57a-48c7-4edb-949b-68183d2d7209 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:08.043334 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3ab9d57a-48c7-4edb-949b-68183d2d7209 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:08.044517 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-3ab9d57a-48c7-4edb-949b-68183d2d7209 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1672 microversion: 2.20 time: 0.155466 Jul 25 06:05:08.045077 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 493/965] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:07 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:08.514339 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a8c3a658-b01c-424e-b3c6-230b335a50a4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:08.515067 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a8c3a658-b01c-424e-b3c6-230b335a50a4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:08.522942 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a8c3a658-b01c-424e-b3c6-230b335a50a4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:08.523404 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a8c3a658-b01c-424e-b3c6-230b335a50a4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:08.524172 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a8c3a658-b01c-424e-b3c6-230b335a50a4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:08.524609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a8c3a658-b01c-424e-b3c6-230b335a50a4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:08.700326 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-a8c3a658-b01c-424e-b3c6-230b335a50a4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:08.712668 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a8c3a658-b01c-424e-b3c6-230b335a50a4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.198303 Jul 25 06:05:08.712668 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 473/966] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:08 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:09.063882 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-eb974fbd-de18-4948-95c3-f5ae9df7a41b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:09.065238 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-eb974fbd-de18-4948-95c3-f5ae9df7a41b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:09.072182 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-eb974fbd-de18-4948-95c3-f5ae9df7a41b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:09.072762 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-eb974fbd-de18-4948-95c3-f5ae9df7a41b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:09.073416 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-eb974fbd-de18-4948-95c3-f5ae9df7a41b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:09.073855 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-eb974fbd-de18-4948-95c3-f5ae9df7a41b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:09.216562 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-eb974fbd-de18-4948-95c3-f5ae9df7a41b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:09.224661 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-eb974fbd-de18-4948-95c3-f5ae9df7a41b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:09.226364 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-eb974fbd-de18-4948-95c3-f5ae9df7a41b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:09.227321 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-eb974fbd-de18-4948-95c3-f5ae9df7a41b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.167922 Jul 25 06:05:09.227873 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 494/967] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:09 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:09.516976 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e688a120-6228-4086-821b-3b9d7607da6b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:09.516976 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e688a120-6228-4086-821b-3b9d7607da6b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:09.522226 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e688a120-6228-4086-821b-3b9d7607da6b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:09.522716 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e688a120-6228-4086-821b-3b9d7607da6b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:09.523425 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e688a120-6228-4086-821b-3b9d7607da6b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:09.523855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e688a120-6228-4086-821b-3b9d7607da6b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:09.557290 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e688a120-6228-4086-821b-3b9d7607da6b tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments/495ebe12-519d-412b-8ded-77402f3ad8de" status: 200 len: 194 microversion: 2.1 time: 0.047439 Jul 25 06:05:09.557897 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 474/968] 10.222.0.17 () {58 vars in 1412 bytes} [Mon Jul 25 06:05:09 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments/495ebe12-519d-412b-8ded-77402f3ad8de => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:09.567895 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-580b349e-ab9d-4f6b-b497-f14c7c35b461 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:09.573996 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-580b349e-ab9d-4f6b-b497-f14c7c35b461 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:09.574774 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-580b349e-ab9d-4f6b-b497-f14c7c35b461 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:09.575220 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-580b349e-ab9d-4f6b-b497-f14c7c35b461 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:09.575999 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-580b349e-ab9d-4f6b-b497-f14c7c35b461 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:09.576430 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-580b349e-ab9d-4f6b-b497-f14c7c35b461 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:09.670350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.objects.instance [None req-580b349e-ab9d-4f6b-b497-f14c7c35b461 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lazy-loading 'services' on Instance uuid 62d77f24-3139-4a33-85bb-a51141e58ce2 {{(pid=130163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:05:09.726598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-5bce84a1-b8b7-4ca0-9216-354ef9fdb3f3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:09.727659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-5bce84a1-b8b7-4ca0-9216-354ef9fdb3f3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:09.734057 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5bce84a1-b8b7-4ca0-9216-354ef9fdb3f3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:09.738259 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5bce84a1-b8b7-4ca0-9216-354ef9fdb3f3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:09.738259 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5bce84a1-b8b7-4ca0-9216-354ef9fdb3f3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:09.738259 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-5bce84a1-b8b7-4ca0-9216-354ef9fdb3f3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:09.911642 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-580b349e-ab9d-4f6b-b497-f14c7c35b461 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "DELETE /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments/495ebe12-519d-412b-8ded-77402f3ad8de" status: 202 len: 0 microversion: 2.1 time: 0.347519 Jul 25 06:05:09.916305 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 495/969] 10.222.0.17 () {58 vars in 1415 bytes} [Mon Jul 25 06:05:09 2022] DELETE /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments/495ebe12-519d-412b-8ded-77402f3ad8de => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:05:10.005329 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-5bce84a1-b8b7-4ca0-9216-354ef9fdb3f3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:10.013521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-5bce84a1-b8b7-4ca0-9216-354ef9fdb3f3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.291028 Jul 25 06:05:10.014125 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 475/970] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:09 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:05:10.247477 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d40e3f8a-a393-4503-addf-0d765df412d8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:10.248282 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d40e3f8a-a393-4503-addf-0d765df412d8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:10.255312 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d40e3f8a-a393-4503-addf-0d765df412d8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:10.255755 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d40e3f8a-a393-4503-addf-0d765df412d8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:10.256556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d40e3f8a-a393-4503-addf-0d765df412d8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:10.256995 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d40e3f8a-a393-4503-addf-0d765df412d8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:10.393257 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d40e3f8a-a393-4503-addf-0d765df412d8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:10.401815 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d40e3f8a-a393-4503-addf-0d765df412d8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:10.403361 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d40e3f8a-a393-4503-addf-0d765df412d8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:10.404530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d40e3f8a-a393-4503-addf-0d765df412d8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.161873 Jul 25 06:05:10.405086 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 496/971] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:10 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:11.031844 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-dda2bfdd-d60b-47b3-9a65-442a10c5471a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:11.032456 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-dda2bfdd-d60b-47b3-9a65-442a10c5471a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:11.039630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dda2bfdd-d60b-47b3-9a65-442a10c5471a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:11.044083 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dda2bfdd-d60b-47b3-9a65-442a10c5471a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:11.044083 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dda2bfdd-d60b-47b3-9a65-442a10c5471a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:11.044083 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-dda2bfdd-d60b-47b3-9a65-442a10c5471a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:11.172139 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-dda2bfdd-d60b-47b3-9a65-442a10c5471a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:11.179692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-dda2bfdd-d60b-47b3-9a65-442a10c5471a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.151757 Jul 25 06:05:11.180256 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 476/972] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:11 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:11.422613 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f86d3ae4-8665-49f8-ba6b-ebb0a92279f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:11.423228 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f86d3ae4-8665-49f8-ba6b-ebb0a92279f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:11.430141 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f86d3ae4-8665-49f8-ba6b-ebb0a92279f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:11.430623 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f86d3ae4-8665-49f8-ba6b-ebb0a92279f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:11.431382 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f86d3ae4-8665-49f8-ba6b-ebb0a92279f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:11.431818 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f86d3ae4-8665-49f8-ba6b-ebb0a92279f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:11.565801 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f86d3ae4-8665-49f8-ba6b-ebb0a92279f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:11.573597 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f86d3ae4-8665-49f8-ba6b-ebb0a92279f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:11.575119 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f86d3ae4-8665-49f8-ba6b-ebb0a92279f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:11.576269 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f86d3ae4-8665-49f8-ba6b-ebb0a92279f1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.157552 Jul 25 06:05:11.576818 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 497/973] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:11 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:12.196527 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b60921e8-7ead-4767-b276-f63123867b7e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:12.197077 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b60921e8-7ead-4767-b276-f63123867b7e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:12.203759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b60921e8-7ead-4767-b276-f63123867b7e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:12.204232 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b60921e8-7ead-4767-b276-f63123867b7e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:12.204983 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b60921e8-7ead-4767-b276-f63123867b7e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:12.205412 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b60921e8-7ead-4767-b276-f63123867b7e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:12.337969 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b60921e8-7ead-4767-b276-f63123867b7e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:12.345367 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b60921e8-7ead-4767-b276-f63123867b7e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.152754 Jul 25 06:05:12.345953 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 477/974] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:12 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:12.594454 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a83b175d-5c4c-433e-abad-7a5db2890934 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:12.595081 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a83b175d-5c4c-433e-abad-7a5db2890934 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:12.601407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a83b175d-5c4c-433e-abad-7a5db2890934 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:12.601851 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a83b175d-5c4c-433e-abad-7a5db2890934 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:12.602636 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a83b175d-5c4c-433e-abad-7a5db2890934 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:12.603066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a83b175d-5c4c-433e-abad-7a5db2890934 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:12.607091 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:12.739663 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a83b175d-5c4c-433e-abad-7a5db2890934 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:12.747446 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a83b175d-5c4c-433e-abad-7a5db2890934 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:12.748968 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a83b175d-5c4c-433e-abad-7a5db2890934 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:12.750128 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a83b175d-5c4c-433e-abad-7a5db2890934 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.159511 Jul 25 06:05:12.750795 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 498/975] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:12 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:13.362329 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-79a0818b-a9e9-4283-b811-7c1d7128ebcd tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:13.363579 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-79a0818b-a9e9-4283-b811-7c1d7128ebcd tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:13.370091 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-79a0818b-a9e9-4283-b811-7c1d7128ebcd tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:13.370567 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-79a0818b-a9e9-4283-b811-7c1d7128ebcd tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:13.371328 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-79a0818b-a9e9-4283-b811-7c1d7128ebcd tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:13.371758 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-79a0818b-a9e9-4283-b811-7c1d7128ebcd tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:13.496805 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-79a0818b-a9e9-4283-b811-7c1d7128ebcd tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:13.504427 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-79a0818b-a9e9-4283-b811-7c1d7128ebcd tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.145913 Jul 25 06:05:13.504994 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 478/976] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:13 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:13.768963 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-43cf15bf-041e-4858-8c96-b5606545ade9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:13.769487 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-43cf15bf-041e-4858-8c96-b5606545ade9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:13.776028 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-43cf15bf-041e-4858-8c96-b5606545ade9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:13.776469 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-43cf15bf-041e-4858-8c96-b5606545ade9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:13.777219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-43cf15bf-041e-4858-8c96-b5606545ade9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:13.777676 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-43cf15bf-041e-4858-8c96-b5606545ade9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:13.925605 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-43cf15bf-041e-4858-8c96-b5606545ade9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:13.933911 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-43cf15bf-041e-4858-8c96-b5606545ade9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:13.935424 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-43cf15bf-041e-4858-8c96-b5606545ade9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:13.936574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-43cf15bf-041e-4858-8c96-b5606545ade9 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.171684 Jul 25 06:05:13.937141 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 499/977] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:13 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:14.522325 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2795b474-c43c-4497-a07a-75cd3a2a6296 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:14.527446 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2795b474-c43c-4497-a07a-75cd3a2a6296 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:14.529705 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2795b474-c43c-4497-a07a-75cd3a2a6296 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:14.530147 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2795b474-c43c-4497-a07a-75cd3a2a6296 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:14.530953 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2795b474-c43c-4497-a07a-75cd3a2a6296 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:14.531480 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2795b474-c43c-4497-a07a-75cd3a2a6296 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:14.691837 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2795b474-c43c-4497-a07a-75cd3a2a6296 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:14.701743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2795b474-c43c-4497-a07a-75cd3a2a6296 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.184476 Jul 25 06:05:14.705401 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 479/978] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:14 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:14.956075 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-838ca2ac-9ba5-45d0-aa94-0738003b8903 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:14.957328 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-838ca2ac-9ba5-45d0-aa94-0738003b8903 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:14.965014 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-838ca2ac-9ba5-45d0-aa94-0738003b8903 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:14.965984 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-838ca2ac-9ba5-45d0-aa94-0738003b8903 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:14.967068 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-838ca2ac-9ba5-45d0-aa94-0738003b8903 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:14.967829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-838ca2ac-9ba5-45d0-aa94-0738003b8903 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:15.131697 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-838ca2ac-9ba5-45d0-aa94-0738003b8903 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:15.140701 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-838ca2ac-9ba5-45d0-aa94-0738003b8903 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:15.147335 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-838ca2ac-9ba5-45d0-aa94-0738003b8903 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:15.152597 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-838ca2ac-9ba5-45d0-aa94-0738003b8903 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.200005 Jul 25 06:05:15.161929 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 500/979] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:14 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:15.317727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1b77f21c-e718-4609-b4b5-8c459aa7c875 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:15.318823 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1b77f21c-e718-4609-b4b5-8c459aa7c875 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:15.330092 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1b77f21c-e718-4609-b4b5-8c459aa7c875 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:15.330570 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1b77f21c-e718-4609-b4b5-8c459aa7c875 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:15.331463 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1b77f21c-e718-4609-b4b5-8c459aa7c875 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:15.331969 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1b77f21c-e718-4609-b4b5-8c459aa7c875 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:15.366737 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1b77f21c-e718-4609-b4b5-8c459aa7c875 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053732 Jul 25 06:05:15.367645 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 480/980] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:15 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 06:05:15.490590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d1c53e4c-7ac6-4c57-93ab-6545c2ef63b5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:15.491933 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d1c53e4c-7ac6-4c57-93ab-6545c2ef63b5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:15.498793 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d1c53e4c-7ac6-4c57-93ab-6545c2ef63b5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:15.499555 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d1c53e4c-7ac6-4c57-93ab-6545c2ef63b5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:15.500533 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d1c53e4c-7ac6-4c57-93ab-6545c2ef63b5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:15.501173 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d1c53e4c-7ac6-4c57-93ab-6545c2ef63b5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:15.539339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d1c53e4c-7ac6-4c57-93ab-6545c2ef63b5 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053652 Jul 25 06:05:15.540132 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 501/981] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:15 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 06:05:15.600501 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-17e0ec1f-e1bc-4581-b896-ea214d1016ce tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:15.601138 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-17e0ec1f-e1bc-4581-b896-ea214d1016ce tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:15.607628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-17e0ec1f-e1bc-4581-b896-ea214d1016ce tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:15.608075 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-17e0ec1f-e1bc-4581-b896-ea214d1016ce tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:15.608832 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-17e0ec1f-e1bc-4581-b896-ea214d1016ce tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:15.609420 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-17e0ec1f-e1bc-4581-b896-ea214d1016ce tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:15.638616 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-17e0ec1f-e1bc-4581-b896-ea214d1016ce tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Going to try to terminate instance {{(pid=130162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:05:15.719516 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-95415d6e-cdcc-49c2-be0d-dae10bcdc3ba tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:15.720151 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-95415d6e-cdcc-49c2-be0d-dae10bcdc3ba tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:15.728228 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-95415d6e-cdcc-49c2-be0d-dae10bcdc3ba tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:15.732439 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-95415d6e-cdcc-49c2-be0d-dae10bcdc3ba tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:15.732439 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-95415d6e-cdcc-49c2-be0d-dae10bcdc3ba tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:15.732439 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-95415d6e-cdcc-49c2-be0d-dae10bcdc3ba tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:15.886947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-95415d6e-cdcc-49c2-be0d-dae10bcdc3ba tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:15.899197 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-95415d6e-cdcc-49c2-be0d-dae10bcdc3ba tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.179919 Jul 25 06:05:15.899197 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 502/982] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:15 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:05:15.973003 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-17e0ec1f-e1bc-4581-b896-ea214d1016ce tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "DELETE /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 204 len: 0 microversion: 2.1 time: 0.376124 Jul 25 06:05:15.974037 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 481/983] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:05:15 2022] DELETE /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:05:15.986901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f1aa4ee9-fd97-409e-92ff-cae37f634561 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:15.987519 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f1aa4ee9-fd97-409e-92ff-cae37f634561 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:15.994382 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f1aa4ee9-fd97-409e-92ff-cae37f634561 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:15.994929 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f1aa4ee9-fd97-409e-92ff-cae37f634561 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:15.995899 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f1aa4ee9-fd97-409e-92ff-cae37f634561 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:15.996363 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f1aa4ee9-fd97-409e-92ff-cae37f634561 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:16.142965 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f1aa4ee9-fd97-409e-92ff-cae37f634561 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:16.152127 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f1aa4ee9-fd97-409e-92ff-cae37f634561 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1672 microversion: 2.1 time: 0.168944 Jul 25 06:05:16.153243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 503/984] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:15 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:05:16.173167 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-91ea7c49-cf28-4ea8-bb87-bf4da00db2eb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:16.174123 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-91ea7c49-cf28-4ea8-bb87-bf4da00db2eb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:16.180685 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-91ea7c49-cf28-4ea8-bb87-bf4da00db2eb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:16.181122 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-91ea7c49-cf28-4ea8-bb87-bf4da00db2eb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:16.181961 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-91ea7c49-cf28-4ea8-bb87-bf4da00db2eb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:16.182425 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-91ea7c49-cf28-4ea8-bb87-bf4da00db2eb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:16.333844 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-91ea7c49-cf28-4ea8-bb87-bf4da00db2eb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:16.342843 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-91ea7c49-cf28-4ea8-bb87-bf4da00db2eb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:16.344924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-91ea7c49-cf28-4ea8-bb87-bf4da00db2eb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:16.346109 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-91ea7c49-cf28-4ea8-bb87-bf4da00db2eb tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.178664 Jul 25 06:05:16.346694 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 482/985] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:16 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:16.916616 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a5f2911c-d238-4633-baca-1e755f86daf2 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:16.917227 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a5f2911c-d238-4633-baca-1e755f86daf2 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:16.924058 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a5f2911c-d238-4633-baca-1e755f86daf2 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:16.924522 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a5f2911c-d238-4633-baca-1e755f86daf2 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:16.925275 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a5f2911c-d238-4633-baca-1e755f86daf2 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:16.926311 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a5f2911c-d238-4633-baca-1e755f86daf2 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:17.090918 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a5f2911c-d238-4633-baca-1e755f86daf2 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:17.101961 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a5f2911c-d238-4633-baca-1e755f86daf2 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.189049 Jul 25 06:05:17.116532 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 504/986] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:16 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:17.169558 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-278f66e7-bd4a-43af-9053-ca10005a8f57 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:17.170782 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-278f66e7-bd4a-43af-9053-ca10005a8f57 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:17.179050 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-278f66e7-bd4a-43af-9053-ca10005a8f57 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:17.179691 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-278f66e7-bd4a-43af-9053-ca10005a8f57 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:17.180634 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-278f66e7-bd4a-43af-9053-ca10005a8f57 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:17.181213 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-278f66e7-bd4a-43af-9053-ca10005a8f57 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:17.365328 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-104b9dde-f421-4758-a0ac-ffe964d41ea8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:17.366729 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-104b9dde-f421-4758-a0ac-ffe964d41ea8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:17.377795 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-278f66e7-bd4a-43af-9053-ca10005a8f57 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:17.379927 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-104b9dde-f421-4758-a0ac-ffe964d41ea8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:17.380572 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-104b9dde-f421-4758-a0ac-ffe964d41ea8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:17.381536 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-104b9dde-f421-4758-a0ac-ffe964d41ea8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:17.382125 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-104b9dde-f421-4758-a0ac-ffe964d41ea8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:17.383768 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:17.390936 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-278f66e7-bd4a-43af-9053-ca10005a8f57 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1672 microversion: 2.1 time: 0.225262 Jul 25 06:05:17.392366 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 483/987] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:17 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1672 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:17.536651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-104b9dde-f421-4758-a0ac-ffe964d41ea8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:17.545295 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-104b9dde-f421-4758-a0ac-ffe964d41ea8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:17.546835 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-104b9dde-f421-4758-a0ac-ffe964d41ea8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:17.548003 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-104b9dde-f421-4758-a0ac-ffe964d41ea8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.187314 Jul 25 06:05:17.548559 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 505/988] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:17 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:18.124838 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1ec170d6-ab93-42b6-87c5-1aafe36e98cd tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:18.125609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1ec170d6-ab93-42b6-87c5-1aafe36e98cd tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:18.132944 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1ec170d6-ab93-42b6-87c5-1aafe36e98cd tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:18.133394 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1ec170d6-ab93-42b6-87c5-1aafe36e98cd tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:18.134200 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1ec170d6-ab93-42b6-87c5-1aafe36e98cd tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:18.134713 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1ec170d6-ab93-42b6-87c5-1aafe36e98cd tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:18.279275 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1ec170d6-ab93-42b6-87c5-1aafe36e98cd tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:18.287514 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1ec170d6-ab93-42b6-87c5-1aafe36e98cd tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.167234 Jul 25 06:05:18.288089 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 484/989] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:18 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:18.412257 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e66749e5-c81f-4070-8233-cf4e951e1607 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:18.412915 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e66749e5-c81f-4070-8233-cf4e951e1607 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:18.419698 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e66749e5-c81f-4070-8233-cf4e951e1607 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:18.420142 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e66749e5-c81f-4070-8233-cf4e951e1607 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:18.420912 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e66749e5-c81f-4070-8233-cf4e951e1607 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:18.421344 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e66749e5-c81f-4070-8233-cf4e951e1607 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:18.567346 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ab109380-db2d-4704-aafb-a23ba696c9f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:18.568208 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ab109380-db2d-4704-aafb-a23ba696c9f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:18.573352 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e66749e5-c81f-4070-8233-cf4e951e1607 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:18.575320 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ab109380-db2d-4704-aafb-a23ba696c9f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:18.575880 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ab109380-db2d-4704-aafb-a23ba696c9f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:18.576727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ab109380-db2d-4704-aafb-a23ba696c9f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:18.577234 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ab109380-db2d-4704-aafb-a23ba696c9f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:18.593064 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e66749e5-c81f-4070-8233-cf4e951e1607 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1672 microversion: 2.1 time: 0.184839 Jul 25 06:05:18.604298 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 506/990] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:18 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1672 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:18.710356 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-794b53b7-ba33-4043-b45f-d76b6802d068 req-d543a988-4cbe-4027-9ad7-6d89bc0b0825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1007f9b0-08e2-4d72-91e9-586792d0695b", "name": "network-vif-unplugged", "status": "completed", "tag": "3dfa9b78-4afb-4b3a-b13e-7a68f5d8ecc8"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:18.730059 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-794b53b7-ba33-4043-b45f-d76b6802d068 req-d543a988-4cbe-4027-9ad7-6d89bc0b0825 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:18.730527 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-794b53b7-ba33-4043-b45f-d76b6802d068 req-d543a988-4cbe-4027-9ad7-6d89bc0b0825 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:18.748450 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-794b53b7-ba33-4043-b45f-d76b6802d068 req-d543a988-4cbe-4027-9ad7-6d89bc0b0825 service nova] Creating event network-vif-unplugged:3dfa9b78-4afb-4b3a-b13e-7a68f5d8ecc8 for instance 1007f9b0-08e2-4d72-91e9-586792d0695b on hv-cinder-85083 Jul 25 06:05:18.760959 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-794b53b7-ba33-4043-b45f-d76b6802d068 req-d543a988-4cbe-4027-9ad7-6d89bc0b0825 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054267 Jul 25 06:05:18.763291 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 507/991] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:18.804564 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ab109380-db2d-4704-aafb-a23ba696c9f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:18.814125 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ab109380-db2d-4704-aafb-a23ba696c9f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:18.816937 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ab109380-db2d-4704-aafb-a23ba696c9f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:18.818204 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ab109380-db2d-4704-aafb-a23ba696c9f6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.255653 Jul 25 06:05:18.819467 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 485/992] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:18 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:19.306290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b55258ed-9b0b-4b81-9c9e-f69d7c9cf8e3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:19.307082 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b55258ed-9b0b-4b81-9c9e-f69d7c9cf8e3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:19.313682 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b55258ed-9b0b-4b81-9c9e-f69d7c9cf8e3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:19.314135 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b55258ed-9b0b-4b81-9c9e-f69d7c9cf8e3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:19.314937 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b55258ed-9b0b-4b81-9c9e-f69d7c9cf8e3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:19.315370 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b55258ed-9b0b-4b81-9c9e-f69d7c9cf8e3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:19.454724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b55258ed-9b0b-4b81-9c9e-f69d7c9cf8e3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:19.463071 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b55258ed-9b0b-4b81-9c9e-f69d7c9cf8e3 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.161006 Jul 25 06:05:19.463721 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 508/993] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:19 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:19.611780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-978ea730-b034-4997-b63f-570b54988ea1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:19.612392 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-978ea730-b034-4997-b63f-570b54988ea1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:19.621650 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-978ea730-b034-4997-b63f-570b54988ea1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:19.622129 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-978ea730-b034-4997-b63f-570b54988ea1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:19.623167 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-978ea730-b034-4997-b63f-570b54988ea1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:19.623608 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-978ea730-b034-4997-b63f-570b54988ea1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:19.765745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-978ea730-b034-4997-b63f-570b54988ea1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:19.774029 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-978ea730-b034-4997-b63f-570b54988ea1 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1672 microversion: 2.1 time: 0.166182 Jul 25 06:05:19.774629 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 486/994] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:19 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:19.837854 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-0cd833d6-3563-49aa-be5b-dd6e5f100a2d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:19.838481 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-0cd833d6-3563-49aa-be5b-dd6e5f100a2d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:19.846829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0cd833d6-3563-49aa-be5b-dd6e5f100a2d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:19.847592 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0cd833d6-3563-49aa-be5b-dd6e5f100a2d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:19.848538 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0cd833d6-3563-49aa-be5b-dd6e5f100a2d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:19.849381 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0cd833d6-3563-49aa-be5b-dd6e5f100a2d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:20.002378 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-0cd833d6-3563-49aa-be5b-dd6e5f100a2d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:20.012379 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-0cd833d6-3563-49aa-be5b-dd6e5f100a2d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:20.014216 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-0cd833d6-3563-49aa-be5b-dd6e5f100a2d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:20.015675 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-0cd833d6-3563-49aa-be5b-dd6e5f100a2d tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.182014 Jul 25 06:05:20.016455 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 509/995] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:19 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:20.481152 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3d2d07c5-5799-4ddd-ae3d-78253bf278e4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:20.481769 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3d2d07c5-5799-4ddd-ae3d-78253bf278e4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:20.488629 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3d2d07c5-5799-4ddd-ae3d-78253bf278e4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:20.489376 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3d2d07c5-5799-4ddd-ae3d-78253bf278e4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:20.489550 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3d2d07c5-5799-4ddd-ae3d-78253bf278e4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:20.489984 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3d2d07c5-5799-4ddd-ae3d-78253bf278e4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:20.697892 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3d2d07c5-5799-4ddd-ae3d-78253bf278e4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:20.707746 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3d2d07c5-5799-4ddd-ae3d-78253bf278e4 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.230333 Jul 25 06:05:20.708336 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 487/996] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:20 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:20.792315 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9c4c419f-a28e-483c-9bcd-2e61d3d14be2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:20.794118 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-9c4c419f-a28e-483c-9bcd-2e61d3d14be2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:20.806442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9c4c419f-a28e-483c-9bcd-2e61d3d14be2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:20.807096 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9c4c419f-a28e-483c-9bcd-2e61d3d14be2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:20.808019 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9c4c419f-a28e-483c-9bcd-2e61d3d14be2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:20.808549 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9c4c419f-a28e-483c-9bcd-2e61d3d14be2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:20.986080 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9c4c419f-a28e-483c-9bcd-2e61d3d14be2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:20.997129 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9c4c419f-a28e-483c-9bcd-2e61d3d14be2 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1672 microversion: 2.1 time: 0.208482 Jul 25 06:05:21.010669 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 510/997] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:20 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1672 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:21.035733 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-19c701ce-975a-46d3-ba8d-d96d08df5fdc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:21.036256 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-19c701ce-975a-46d3-ba8d-d96d08df5fdc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:21.042892 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-19c701ce-975a-46d3-ba8d-d96d08df5fdc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:21.043421 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-19c701ce-975a-46d3-ba8d-d96d08df5fdc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:21.044176 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-19c701ce-975a-46d3-ba8d-d96d08df5fdc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:21.044653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-19c701ce-975a-46d3-ba8d-d96d08df5fdc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:21.203129 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-19c701ce-975a-46d3-ba8d-d96d08df5fdc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:21.214990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-19c701ce-975a-46d3-ba8d-d96d08df5fdc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:21.217238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-19c701ce-975a-46d3-ba8d-d96d08df5fdc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:21.218724 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-19c701ce-975a-46d3-ba8d-d96d08df5fdc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.187493 Jul 25 06:05:21.219720 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 488/998] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:21 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:21.726727 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8544e972-2522-417b-872b-7041f9ac0799 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:21.727981 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8544e972-2522-417b-872b-7041f9ac0799 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:21.734281 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8544e972-2522-417b-872b-7041f9ac0799 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:21.734757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8544e972-2522-417b-872b-7041f9ac0799 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:21.735535 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8544e972-2522-417b-872b-7041f9ac0799 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:21.735972 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8544e972-2522-417b-872b-7041f9ac0799 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:21.886992 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8544e972-2522-417b-872b-7041f9ac0799 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:21.915777 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8544e972-2522-417b-872b-7041f9ac0799 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.192900 Jul 25 06:05:21.916523 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 511/999] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:21 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:22.015074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-da5f6db9-5c75-4757-b01b-9de9d842a8e7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:22.015891 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-da5f6db9-5c75-4757-b01b-9de9d842a8e7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:22.025586 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-da5f6db9-5c75-4757-b01b-9de9d842a8e7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:22.026152 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-da5f6db9-5c75-4757-b01b-9de9d842a8e7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:22.027029 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-da5f6db9-5c75-4757-b01b-9de9d842a8e7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:22.027495 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-da5f6db9-5c75-4757-b01b-9de9d842a8e7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:22.176641 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-da5f6db9-5c75-4757-b01b-9de9d842a8e7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:22.185066 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-da5f6db9-5c75-4757-b01b-9de9d842a8e7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1672 microversion: 2.1 time: 0.174576 Jul 25 06:05:22.186664 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 489/1000] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:22 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1672 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:22.240182 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d75bc5b5-2994-4158-be8f-157ce1c5b3db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:22.240805 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d75bc5b5-2994-4158-be8f-157ce1c5b3db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:22.258139 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d75bc5b5-2994-4158-be8f-157ce1c5b3db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:22.258648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d75bc5b5-2994-4158-be8f-157ce1c5b3db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:22.259432 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d75bc5b5-2994-4158-be8f-157ce1c5b3db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:22.259999 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d75bc5b5-2994-4158-be8f-157ce1c5b3db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:22.429334 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d75bc5b5-2994-4158-be8f-157ce1c5b3db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:22.437334 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d75bc5b5-2994-4158-be8f-157ce1c5b3db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:22.444003 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d75bc5b5-2994-4158-be8f-157ce1c5b3db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:22.444003 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d75bc5b5-2994-4158-be8f-157ce1c5b3db tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.206460 Jul 25 06:05:22.444003 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 512/1001] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:22 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:22.934195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-58a91010-106c-4caf-a603-012c4c06b38f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:22.934759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-58a91010-106c-4caf-a603-012c4c06b38f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:22.936583 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:22.941269 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-58a91010-106c-4caf-a603-012c4c06b38f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:22.941710 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-58a91010-106c-4caf-a603-012c4c06b38f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:22.942521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-58a91010-106c-4caf-a603-012c4c06b38f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:22.942956 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-58a91010-106c-4caf-a603-012c4c06b38f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:23.081262 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-58a91010-106c-4caf-a603-012c4c06b38f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:23.088957 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-58a91010-106c-4caf-a603-012c4c06b38f tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.158724 Jul 25 06:05:23.089519 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 490/1002] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:22 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:23.202770 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-174fb33a-887f-40f5-9e11-a00ebd0b5939 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:23.203350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-174fb33a-887f-40f5-9e11-a00ebd0b5939 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:23.210412 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-174fb33a-887f-40f5-9e11-a00ebd0b5939 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:23.210952 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-174fb33a-887f-40f5-9e11-a00ebd0b5939 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:23.211745 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-174fb33a-887f-40f5-9e11-a00ebd0b5939 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:23.212180 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-174fb33a-887f-40f5-9e11-a00ebd0b5939 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:23.344890 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-174fb33a-887f-40f5-9e11-a00ebd0b5939 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:23.353010 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-174fb33a-887f-40f5-9e11-a00ebd0b5939 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1672 microversion: 2.1 time: 0.154179 Jul 25 06:05:23.353580 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 513/1003] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:23 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:23.458134 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8a930f2a-4890-411f-b25c-940f329ded5c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:23.458712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8a930f2a-4890-411f-b25c-940f329ded5c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:23.464681 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8a930f2a-4890-411f-b25c-940f329ded5c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:23.470000 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8a930f2a-4890-411f-b25c-940f329ded5c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:23.470000 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8a930f2a-4890-411f-b25c-940f329ded5c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:23.470000 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8a930f2a-4890-411f-b25c-940f329ded5c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:23.600864 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8a930f2a-4890-411f-b25c-940f329ded5c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:23.608785 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8a930f2a-4890-411f-b25c-940f329ded5c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:23.610291 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8a930f2a-4890-411f-b25c-940f329ded5c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:23.611470 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-8a930f2a-4890-411f-b25c-940f329ded5c tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.157780 Jul 25 06:05:23.612058 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 491/1004] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:23 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:24.107829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-0e4706c1-0651-4256-ac03-8b0b37331a31 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:24.108573 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-0e4706c1-0651-4256-ac03-8b0b37331a31 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:24.115378 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0e4706c1-0651-4256-ac03-8b0b37331a31 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:24.115823 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0e4706c1-0651-4256-ac03-8b0b37331a31 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:24.116586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0e4706c1-0651-4256-ac03-8b0b37331a31 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:24.117016 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-0e4706c1-0651-4256-ac03-8b0b37331a31 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:24.255202 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-0e4706c1-0651-4256-ac03-8b0b37331a31 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:24.263930 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-0e4706c1-0651-4256-ac03-8b0b37331a31 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.158636 Jul 25 06:05:24.263930 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 514/1005] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:24 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:24.369945 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cdd097a8-428a-4a0b-9abc-a3eeec783603 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:24.370449 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-cdd097a8-428a-4a0b-9abc-a3eeec783603 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:24.376777 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cdd097a8-428a-4a0b-9abc-a3eeec783603 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:24.383787 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cdd097a8-428a-4a0b-9abc-a3eeec783603 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:24.383787 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cdd097a8-428a-4a0b-9abc-a3eeec783603 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:24.383787 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cdd097a8-428a-4a0b-9abc-a3eeec783603 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:24.506299 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cdd097a8-428a-4a0b-9abc-a3eeec783603 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:24.513829 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-cdd097a8-428a-4a0b-9abc-a3eeec783603 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1672 microversion: 2.1 time: 0.147779 Jul 25 06:05:24.514453 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 492/1006] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:24 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:24.629050 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e08b3fba-4f69-42ae-9e88-2b66a7df1a58 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:24.629931 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e08b3fba-4f69-42ae-9e88-2b66a7df1a58 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:24.636504 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e08b3fba-4f69-42ae-9e88-2b66a7df1a58 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:24.641728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e08b3fba-4f69-42ae-9e88-2b66a7df1a58 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:24.641728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e08b3fba-4f69-42ae-9e88-2b66a7df1a58 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:24.641728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e08b3fba-4f69-42ae-9e88-2b66a7df1a58 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:24.656591 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=100 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:24.767386 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e08b3fba-4f69-42ae-9e88-2b66a7df1a58 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:24.776392 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e08b3fba-4f69-42ae-9e88-2b66a7df1a58 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:24.777964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-e08b3fba-4f69-42ae-9e88-2b66a7df1a58 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:24.779652 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e08b3fba-4f69-42ae-9e88-2b66a7df1a58 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.154230 Jul 25 06:05:24.782880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 515/1007] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:24 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:25.279819 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d4d054d1-0273-4158-a33d-37b75f0c5ba7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:25.280431 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d4d054d1-0273-4158-a33d-37b75f0c5ba7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:25.286463 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d4d054d1-0273-4158-a33d-37b75f0c5ba7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:25.286933 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d4d054d1-0273-4158-a33d-37b75f0c5ba7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:25.287687 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d4d054d1-0273-4158-a33d-37b75f0c5ba7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:25.288117 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d4d054d1-0273-4158-a33d-37b75f0c5ba7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:25.424711 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d4d054d1-0273-4158-a33d-37b75f0c5ba7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:25.432746 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d4d054d1-0273-4158-a33d-37b75f0c5ba7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1568 microversion: 2.1 time: 0.156792 Jul 25 06:05:25.433940 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 493/1008] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:25 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:25.449826 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4871020c-cbc8-4837-9fee-d1d9790e74c6 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:25.450401 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4871020c-cbc8-4837-9fee-d1d9790e74c6 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:25.456935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4871020c-cbc8-4837-9fee-d1d9790e74c6 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:25.457453 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4871020c-cbc8-4837-9fee-d1d9790e74c6 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:25.458220 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4871020c-cbc8-4837-9fee-d1d9790e74c6 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:25.458689 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4871020c-cbc8-4837-9fee-d1d9790e74c6 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:25.531895 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-c9faf0ed-43ba-45b6-b377-73cc9d883c62 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:25.531895 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-c9faf0ed-43ba-45b6-b377-73cc9d883c62 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:25.537402 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c9faf0ed-43ba-45b6-b377-73cc9d883c62 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:25.537860 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c9faf0ed-43ba-45b6-b377-73cc9d883c62 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:25.538651 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c9faf0ed-43ba-45b6-b377-73cc9d883c62 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:25.539086 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c9faf0ed-43ba-45b6-b377-73cc9d883c62 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:25.676782 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-c9faf0ed-43ba-45b6-b377-73cc9d883c62 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:25.684197 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-c9faf0ed-43ba-45b6-b377-73cc9d883c62 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1672 microversion: 2.1 time: 0.157154 Jul 25 06:05:25.684968 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 494/1009] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:25 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:05:25.720855 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4871020c-cbc8-4837-9fee-d1d9790e74c6 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "POST /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b/action" status: 202 len: 0 microversion: 2.1 time: 0.274655 Jul 25 06:05:25.722337 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 516/1010] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 06:05:25 2022] POST /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:05:25.732137 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-37c24fe0-2a57-4d89-8966-b0ccbe307261 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:25.732842 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-37c24fe0-2a57-4d89-8966-b0ccbe307261 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:25.741041 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-37c24fe0-2a57-4d89-8966-b0ccbe307261 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:25.741491 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-37c24fe0-2a57-4d89-8966-b0ccbe307261 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:25.742756 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-37c24fe0-2a57-4d89-8966-b0ccbe307261 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:25.744429 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-37c24fe0-2a57-4d89-8966-b0ccbe307261 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:25.797322 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-277fce98-8f08-45b3-8c49-c401e3f24441 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:25.797853 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-277fce98-8f08-45b3-8c49-c401e3f24441 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:25.804571 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-277fce98-8f08-45b3-8c49-c401e3f24441 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:25.805119 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-277fce98-8f08-45b3-8c49-c401e3f24441 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:25.806032 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-277fce98-8f08-45b3-8c49-c401e3f24441 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:25.806568 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-277fce98-8f08-45b3-8c49-c401e3f24441 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:25.976240 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-277fce98-8f08-45b3-8c49-c401e3f24441 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:25.984528 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-277fce98-8f08-45b3-8c49-c401e3f24441 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:25.992307 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-277fce98-8f08-45b3-8c49-c401e3f24441 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:25.993623 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-277fce98-8f08-45b3-8c49-c401e3f24441 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.200240 Jul 25 06:05:25.995131 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 517/1011] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:25 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:05:26.006335 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-37c24fe0-2a57-4d89-8966-b0ccbe307261 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:26.016699 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-37c24fe0-2a57-4d89-8966-b0ccbe307261 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1576 microversion: 2.1 time: 0.289176 Jul 25 06:05:26.017287 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 495/1012] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:25 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1576 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:05:26.710113 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a930c1ab-5b44-4f55-b9ac-5dd19091bba7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:26.713079 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a930c1ab-5b44-4f55-b9ac-5dd19091bba7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:26.735670 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a930c1ab-5b44-4f55-b9ac-5dd19091bba7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:26.736469 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a930c1ab-5b44-4f55-b9ac-5dd19091bba7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:26.737194 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a930c1ab-5b44-4f55-b9ac-5dd19091bba7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:26.743011 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a930c1ab-5b44-4f55-b9ac-5dd19091bba7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:26.762465 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-c12a338f-bf8f-454c-996c-924c10b696d3 req-4a2200c8-bab1-4068-95a4-e67d4070c1be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d77f24-3139-4a33-85bb-a51141e58ce2", "name": "network-vif-deleted", "tag": "3af24c18-6fc2-4b74-a3ab-afaa89b2efe0"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:26.776877 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-c12a338f-bf8f-454c-996c-924c10b696d3 req-4a2200c8-bab1-4068-95a4-e67d4070c1be service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:26.777310 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-c12a338f-bf8f-454c-996c-924c10b696d3 req-4a2200c8-bab1-4068-95a4-e67d4070c1be service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:26.801880 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-c12a338f-bf8f-454c-996c-924c10b696d3 req-4a2200c8-bab1-4068-95a4-e67d4070c1be service nova] Creating event network-vif-deleted:3af24c18-6fc2-4b74-a3ab-afaa89b2efe0 for instance 62d77f24-3139-4a33-85bb-a51141e58ce2 on hv-cinder-85083 Jul 25 06:05:26.809436 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-c12a338f-bf8f-454c-996c-924c10b696d3 req-4a2200c8-bab1-4068-95a4-e67d4070c1be service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049458 Jul 25 06:05:26.813657 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 496/1013] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:05:26.839944 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a930c1ab-5b44-4f55-b9ac-5dd19091bba7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:26.850405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a930c1ab-5b44-4f55-b9ac-5dd19091bba7 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1605 microversion: 2.1 time: 0.151830 Jul 25 06:05:26.858893 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 518/1014] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:26 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1605 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:27.016269 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ec684f2c-5b9b-401b-a1cf-cf34ce501c5b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:27.016976 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ec684f2c-5b9b-401b-a1cf-cf34ce501c5b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:27.023952 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ec684f2c-5b9b-401b-a1cf-cf34ce501c5b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:27.024397 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ec684f2c-5b9b-401b-a1cf-cf34ce501c5b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:27.025166 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ec684f2c-5b9b-401b-a1cf-cf34ce501c5b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:27.025600 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ec684f2c-5b9b-401b-a1cf-cf34ce501c5b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:27.036629 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a8190cdd-d5a2-46f9-9664-8e9a2a79d5bc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:27.037262 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a8190cdd-d5a2-46f9-9664-8e9a2a79d5bc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:27.043700 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a8190cdd-d5a2-46f9-9664-8e9a2a79d5bc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:27.044155 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a8190cdd-d5a2-46f9-9664-8e9a2a79d5bc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:27.044941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a8190cdd-d5a2-46f9-9664-8e9a2a79d5bc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:27.045570 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a8190cdd-d5a2-46f9-9664-8e9a2a79d5bc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:27.167424 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ec684f2c-5b9b-401b-a1cf-cf34ce501c5b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:27.182561 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ec684f2c-5b9b-401b-a1cf-cf34ce501c5b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:27.184177 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ec684f2c-5b9b-401b-a1cf-cf34ce501c5b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:27.185483 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ec684f2c-5b9b-401b-a1cf-cf34ce501c5b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.174155 Jul 25 06:05:27.186329 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 497/1015] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:27 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:27.211800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a8190cdd-d5a2-46f9-9664-8e9a2a79d5bc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:27.219326 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a8190cdd-d5a2-46f9-9664-8e9a2a79d5bc tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1516 microversion: 2.1 time: 0.187256 Jul 25 06:05:27.219893 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 519/1016] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:27 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1516 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:05:27.867968 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b148ae2c-6711-4d59-a611-f067191f1aae tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:27.868582 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b148ae2c-6711-4d59-a611-f067191f1aae tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:27.875055 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b148ae2c-6711-4d59-a611-f067191f1aae tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:27.875516 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b148ae2c-6711-4d59-a611-f067191f1aae tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:27.876276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b148ae2c-6711-4d59-a611-f067191f1aae tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:27.876707 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b148ae2c-6711-4d59-a611-f067191f1aae tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:27.943268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b148ae2c-6711-4d59-a611-f067191f1aae tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8b3ecc32c14e31b55156586129a40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15678135086b4a5c83eefece6cb8f79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:27.956156 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b148ae2c-6711-4d59-a611-f067191f1aae tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 200 len: 1321 microversion: 2.1 time: 0.091919 Jul 25 06:05:27.957297 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 498/1017] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:27 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 1321 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:28.205531 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3086efb8-4573-48e7-ae31-aff07ff37000 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:28.206138 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-3086efb8-4573-48e7-ae31-aff07ff37000 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:28.213200 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3086efb8-4573-48e7-ae31-aff07ff37000 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:28.213644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3086efb8-4573-48e7-ae31-aff07ff37000 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:28.214505 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3086efb8-4573-48e7-ae31-aff07ff37000 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:28.214920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3086efb8-4573-48e7-ae31-aff07ff37000 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:28.236324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-4a2c34ed-ba2c-4610-a2aa-6b0271718ce5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:28.237137 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-4a2c34ed-ba2c-4610-a2aa-6b0271718ce5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:28.243309 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4a2c34ed-ba2c-4610-a2aa-6b0271718ce5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:28.243905 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4a2c34ed-ba2c-4610-a2aa-6b0271718ce5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:28.244697 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4a2c34ed-ba2c-4610-a2aa-6b0271718ce5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:28.245238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4a2c34ed-ba2c-4610-a2aa-6b0271718ce5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:28.362765 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3086efb8-4573-48e7-ae31-aff07ff37000 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:28.368618 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3086efb8-4573-48e7-ae31-aff07ff37000 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:28.370636 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3086efb8-4573-48e7-ae31-aff07ff37000 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:28.372082 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-3086efb8-4573-48e7-ae31-aff07ff37000 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.170360 Jul 25 06:05:28.383873 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 520/1018] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:28 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:28.386512 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4a2c34ed-ba2c-4610-a2aa-6b0271718ce5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:28.395786 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-4a2c34ed-ba2c-4610-a2aa-6b0271718ce5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1518 microversion: 2.1 time: 0.163328 Jul 25 06:05:28.396366 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 499/1019] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:28 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:05:28.729136 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-1497eb39-5362-4d91-bb2b-b0fdf8a233b9 req-d746acb5-d677-4240-9f5a-ecc4dc070f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339de78a-2525-478a-842f-faea8fc424e2", "name": "network-vif-plugged", "status": "completed", "tag": "5f811af2-0e22-4934-ac4e-1b3da227067b"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:28.737346 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-1497eb39-5362-4d91-bb2b-b0fdf8a233b9 req-d746acb5-d677-4240-9f5a-ecc4dc070f9d service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:28.738308 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-1497eb39-5362-4d91-bb2b-b0fdf8a233b9 req-d746acb5-d677-4240-9f5a-ecc4dc070f9d service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:28.749055 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-1497eb39-5362-4d91-bb2b-b0fdf8a233b9 req-d746acb5-d677-4240-9f5a-ecc4dc070f9d service nova] Creating event network-vif-plugged:5f811af2-0e22-4934-ac4e-1b3da227067b for instance 339de78a-2525-478a-842f-faea8fc424e2 on hv-cinder-85083 Jul 25 06:05:28.754608 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-1497eb39-5362-4d91-bb2b-b0fdf8a233b9 req-d746acb5-d677-4240-9f5a-ecc4dc070f9d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029140 Jul 25 06:05:28.755186 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 521/1020] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:28.973785 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-c09e3dc9-8848-4fa9-ab26-4cb03bddb4ea tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:28.974853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-c09e3dc9-8848-4fa9-ab26-4cb03bddb4ea tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:28.981285 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c09e3dc9-8848-4fa9-ab26-4cb03bddb4ea tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:28.981721 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c09e3dc9-8848-4fa9-ab26-4cb03bddb4ea tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:28.982493 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c09e3dc9-8848-4fa9-ab26-4cb03bddb4ea tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:28.982922 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-c09e3dc9-8848-4fa9-ab26-4cb03bddb4ea tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:28.997468 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-c09e3dc9-8848-4fa9-ab26-4cb03bddb4ea tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] HTTP exception thrown: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-c09e3dc9-8848-4fa9-ab26-4cb03bddb4ea tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Request method failure captured: Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 HTTP/1.1 Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEb7WKhj90_SME0CJ-tXPhbghCaFx2uuZpV8pNIinQO4sRmE3lGwp0m3saWs-iZnHREH481e1y1Psq-ccvxI6HkaheiLRfSxDXJJ56zt-MIjSqwZFiNvokJ9F6bT6TTgBOJy5goqLSHGBvWLqUq5APhQbv4zQGgeA_ijsU77lwEOrs Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: 15678135086b4a5c83eefece6cb8f79a Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:05:29.000352 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:05:29.002036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_15678135086b4a5c83eefece6cb8f79a", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:05:29.002036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:05:29.002036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: 15678135086b4a5c83eefece6cb8f79a Jul 25 06:05:29.002036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:05:29.002036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-AttachVolumeTestJSON-191392914-project Jul 25 06:05:29.002036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:05:29.002036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:05:29.002036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: dc8b3ecc32c14e31b55156586129a40c Jul 25 06:05:29.002036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-AttachVolumeTestJSON-191392914-project Jul 25 06:05:29.002036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:05:29.002036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. Jul 25 06:05:29.002036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '62d77f24-3139-4a33-85bb-a51141e58ce2'} Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:29.002964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. Jul 25 06:05:29.004653 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:29.006444 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-c09e3dc9-8848-4fa9-ab26-4cb03bddb4ea tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Returning 404 to user: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:29.006444 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-c09e3dc9-8848-4fa9-ab26-4cb03bddb4ea tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 404 len: 111 microversion: 2.1 time: 0.031404 Jul 25 06:05:29.006444 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 500/1021] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:28 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:05:29.011389 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-566e4af2-49df-42a6-ae73-c9d3d1aa908e tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '.version_select at 0x7f9d360370d0>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:29.121106 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-566e4af2-49df-42a6-ae73-c9d3d1aa908e tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-921709644" status: 202 len: 0 microversion: 2.1 time: 0.110859 Jul 25 06:05:29.121106 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 522/1022] 10.222.0.17 () {58 vars in 1217 bytes} [Mon Jul 25 06:05:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-921709644 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:05:29.397319 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-610c3ee2-24e5-468e-8c8d-9adf905e9f56 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:29.398747 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-610c3ee2-24e5-468e-8c8d-9adf905e9f56 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:29.405512 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-610c3ee2-24e5-468e-8c8d-9adf905e9f56 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:29.405961 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-610c3ee2-24e5-468e-8c8d-9adf905e9f56 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:29.408705 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-610c3ee2-24e5-468e-8c8d-9adf905e9f56 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:29.408834 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-610c3ee2-24e5-468e-8c8d-9adf905e9f56 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:29.420843 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d6243015-153d-487b-9f58-98f8e741cd0c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:29.424374 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d6243015-153d-487b-9f58-98f8e741cd0c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:29.444191 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d6243015-153d-487b-9f58-98f8e741cd0c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:29.444191 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d6243015-153d-487b-9f58-98f8e741cd0c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:29.444191 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d6243015-153d-487b-9f58-98f8e741cd0c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:29.444191 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d6243015-153d-487b-9f58-98f8e741cd0c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:29.587856 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d6243015-153d-487b-9f58-98f8e741cd0c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:29.596573 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d6243015-153d-487b-9f58-98f8e741cd0c tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1518 microversion: 2.1 time: 0.187033 Jul 25 06:05:29.597195 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 523/1023] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:29 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:05:29.656645 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-610c3ee2-24e5-468e-8c8d-9adf905e9f56 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:29.660320 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=100 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:29.666253 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-610c3ee2-24e5-468e-8c8d-9adf905e9f56 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:29.668075 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-610c3ee2-24e5-468e-8c8d-9adf905e9f56 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:29.669394 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-610c3ee2-24e5-468e-8c8d-9adf905e9f56 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.281126 Jul 25 06:05:29.669992 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 501/1024] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:29 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:05:30.613564 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-332994e1-fe1b-43e1-8810-eb33009af9eb tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:30.614350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-332994e1-fe1b-43e1-8810-eb33009af9eb tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:30.621784 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-332994e1-fe1b-43e1-8810-eb33009af9eb tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:30.624048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-332994e1-fe1b-43e1-8810-eb33009af9eb tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:30.624048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-332994e1-fe1b-43e1-8810-eb33009af9eb tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:30.624048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-332994e1-fe1b-43e1-8810-eb33009af9eb tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:30.687672 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-49523e9f-3d37-4c85-983a-b72e5a22a931 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:30.689661 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-49523e9f-3d37-4c85-983a-b72e5a22a931 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:30.702929 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-49523e9f-3d37-4c85-983a-b72e5a22a931 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:30.704265 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-49523e9f-3d37-4c85-983a-b72e5a22a931 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:30.704473 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-49523e9f-3d37-4c85-983a-b72e5a22a931 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:30.704949 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-49523e9f-3d37-4c85-983a-b72e5a22a931 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:30.776973 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-332994e1-fe1b-43e1-8810-eb33009af9eb tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:30.788016 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-332994e1-fe1b-43e1-8810-eb33009af9eb tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1574 microversion: 2.1 time: 0.177546 Jul 25 06:05:30.797717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 524/1025] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:30 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1574 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:30.859403 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-49523e9f-3d37-4c85-983a-b72e5a22a931 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:30.872590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-63cd0f78-dfae-4f57-99bf-a44ff4950c37 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:30.873166 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-63cd0f78-dfae-4f57-99bf-a44ff4950c37 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:30.874370 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-49523e9f-3d37-4c85-983a-b72e5a22a931 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:30.875914 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-49523e9f-3d37-4c85-983a-b72e5a22a931 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:30.877088 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-49523e9f-3d37-4c85-983a-b72e5a22a931 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1730 microversion: 2.20 time: 0.193802 Jul 25 06:05:30.877639 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 502/1026] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:30 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:30.879500 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63cd0f78-dfae-4f57-99bf-a44ff4950c37 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:30.880058 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63cd0f78-dfae-4f57-99bf-a44ff4950c37 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:30.880836 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63cd0f78-dfae-4f57-99bf-a44ff4950c37 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:30.881460 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63cd0f78-dfae-4f57-99bf-a44ff4950c37 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:30.905844 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-63cd0f78-dfae-4f57-99bf-a44ff4950c37 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46/ips" status: 200 len: 149 microversion: 2.1 time: 0.037091 Jul 25 06:05:30.906543 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 525/1027] 10.222.0.17 () {58 vars in 1247 bytes} [Mon Jul 25 06:05:30 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:05:31.804290 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b1bfce14-a05f-4b06-b1ea-f011fa09b06a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:31.804903 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b1bfce14-a05f-4b06-b1ea-f011fa09b06a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:31.811415 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b1bfce14-a05f-4b06-b1ea-f011fa09b06a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:31.811860 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b1bfce14-a05f-4b06-b1ea-f011fa09b06a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:31.812628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b1bfce14-a05f-4b06-b1ea-f011fa09b06a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:31.813066 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b1bfce14-a05f-4b06-b1ea-f011fa09b06a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:31.896706 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b77fcd31-2724-4d0e-8523-11ff6b1f4034 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:31.898026 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b77fcd31-2724-4d0e-8523-11ff6b1f4034 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:31.904918 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b77fcd31-2724-4d0e-8523-11ff6b1f4034 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:31.905556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b77fcd31-2724-4d0e-8523-11ff6b1f4034 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:31.906561 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b77fcd31-2724-4d0e-8523-11ff6b1f4034 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:31.907011 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b77fcd31-2724-4d0e-8523-11ff6b1f4034 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:31.949942 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b1bfce14-a05f-4b06-b1ea-f011fa09b06a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:31.957799 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b1bfce14-a05f-4b06-b1ea-f011fa09b06a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1574 microversion: 2.1 time: 0.157363 Jul 25 06:05:31.958376 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 503/1028] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:31 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:32.043827 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b77fcd31-2724-4d0e-8523-11ff6b1f4034 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:32.051934 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b77fcd31-2724-4d0e-8523-11ff6b1f4034 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:32.053479 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b77fcd31-2724-4d0e-8523-11ff6b1f4034 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:32.054674 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b77fcd31-2724-4d0e-8523-11ff6b1f4034 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1717 microversion: 2.20 time: 0.162763 Jul 25 06:05:32.055234 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 526/1029] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:31 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:05:32.575616 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-876d0d5a-1cbc-4a52-8980-de0576b3b5bb tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "401ad31f-9743-4d59-aeef-4dc0edf975ab"}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:32.576759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-876d0d5a-1cbc-4a52-8980-de0576b3b5bb tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:32.582745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-876d0d5a-1cbc-4a52-8980-de0576b3b5bb tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:32.583206 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-876d0d5a-1cbc-4a52-8980-de0576b3b5bb tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:32.583969 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-876d0d5a-1cbc-4a52-8980-de0576b3b5bb tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:32.584889 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-876d0d5a-1cbc-4a52-8980-de0576b3b5bb tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:32.763985 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e58d87a1-ec19-4dc0-b2f5-22f5c9ddf7af tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:32.764478 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e58d87a1-ec19-4dc0-b2f5-22f5c9ddf7af tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:32.770431 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e58d87a1-ec19-4dc0-b2f5-22f5c9ddf7af tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:32.770906 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e58d87a1-ec19-4dc0-b2f5-22f5c9ddf7af tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:32.771657 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e58d87a1-ec19-4dc0-b2f5-22f5c9ddf7af tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:32.772115 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e58d87a1-ec19-4dc0-b2f5-22f5c9ddf7af tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:32.785344 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-e58d87a1-ec19-4dc0-b2f5-22f5c9ddf7af tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] HTTP exception thrown: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e58d87a1-ec19-4dc0-b2f5-22f5c9ddf7af tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Request method failure captured: Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: DELETE /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 HTTP/1.1 Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEb7WKhj90_SME0CJ-tXPhbghCaFx2uuZpV8pNIinQO4sRmE3lGwp0m3saWs-iZnHREH481e1y1Psq-ccvxI6HkaheiLRfSxDXJJ56zt-MIjSqwZFiNvokJ9F6bT6TTgBOJy5goqLSHGBvWLqUq5APhQbv4zQGgeA_ijsU77lwEOrs Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 15678135086b4a5c83eefece6cb8f79a Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:05:32.787137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:05:32.788702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_15678135086b4a5c83eefece6cb8f79a", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:05:32.788702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:05:32.788702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 15678135086b4a5c83eefece6cb8f79a Jul 25 06:05:32.788702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:05:32.788702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-AttachVolumeTestJSON-191392914-project Jul 25 06:05:32.788702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:05:32.788702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:05:32.788702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: dc8b3ecc32c14e31b55156586129a40c Jul 25 06:05:32.788702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-AttachVolumeTestJSON-191392914-project Jul 25 06:05:32.788702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:05:32.788702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. Jul 25 06:05:32.788702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '62d77f24-3139-4a33-85bb-a51141e58ce2'} Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:32.789574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. Jul 25 06:05:32.791056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:32.792893 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e58d87a1-ec19-4dc0-b2f5-22f5c9ddf7af tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Returning 404 to user: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:32.792893 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e58d87a1-ec19-4dc0-b2f5-22f5c9ddf7af tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "DELETE /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 404 len: 111 microversion: 2.1 time: 0.028459 Jul 25 06:05:32.792893 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 527/1030] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:05:32 2022] DELETE /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:05:32.796740 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b3771f27-5e3f-4acb-aae7-a5ab8b647a11 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:32.797335 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b3771f27-5e3f-4acb-aae7-a5ab8b647a11 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 62d77f24-3139-4a33-85bb-a51141e58ce2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:32.803120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b3771f27-5e3f-4acb-aae7-a5ab8b647a11 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:32.803568 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b3771f27-5e3f-4acb-aae7-a5ab8b647a11 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:32.804858 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b3771f27-5e3f-4acb-aae7-a5ab8b647a11 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:32.805291 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b3771f27-5e3f-4acb-aae7-a5ab8b647a11 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:32.818614 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-b3771f27-5e3f-4acb-aae7-a5ab8b647a11 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] HTTP exception thrown: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b3771f27-5e3f-4acb-aae7-a5ab8b647a11 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Request method failure captured: Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 HTTP/1.1 Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEb7WKhj90_SME0CJ-tXPhbghCaFx2uuZpV8pNIinQO4sRmE3lGwp0m3saWs-iZnHREH481e1y1Psq-ccvxI6HkaheiLRfSxDXJJ56zt-MIjSqwZFiNvokJ9F6bT6TTgBOJy5goqLSHGBvWLqUq5APhQbv4zQGgeA_ijsU77lwEOrs Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 15678135086b4a5c83eefece6cb8f79a Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:05:32.820841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:05:32.828405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_15678135086b4a5c83eefece6cb8f79a", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:05:32.828405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:05:32.828405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 15678135086b4a5c83eefece6cb8f79a Jul 25 06:05:32.828405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:05:32.828405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-AttachVolumeTestJSON-191392914-project Jul 25 06:05:32.828405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:05:32.828405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:05:32.828405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: dc8b3ecc32c14e31b55156586129a40c Jul 25 06:05:32.828405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-AttachVolumeTestJSON-191392914-project Jul 25 06:05:32.828405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:05:32.828405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. Jul 25 06:05:32.828405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '62d77f24-3139-4a33-85bb-a51141e58ce2'} Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:32.829246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. Jul 25 06:05:32.830525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:32.831605 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b3771f27-5e3f-4acb-aae7-a5ab8b647a11 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Returning 404 to user: Instance 62d77f24-3139-4a33-85bb-a51141e58ce2 could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:32.831605 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b3771f27-5e3f-4acb-aae7-a5ab8b647a11 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2" status: 404 len: 111 microversion: 2.1 time: 0.029185 Jul 25 06:05:32.831605 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 528/1031] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:32 2022] GET /compute/v2.1/servers/62d77f24-3139-4a33-85bb-a51141e58ce2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:05:32.975062 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a217b2ee-51e1-45b8-8314-5d8ca09d645d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:32.976272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a217b2ee-51e1-45b8-8314-5d8ca09d645d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:32.983179 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a217b2ee-51e1-45b8-8314-5d8ca09d645d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:32.983627 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a217b2ee-51e1-45b8-8314-5d8ca09d645d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:32.984396 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a217b2ee-51e1-45b8-8314-5d8ca09d645d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:32.984830 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a217b2ee-51e1-45b8-8314-5d8ca09d645d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:33.134817 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a217b2ee-51e1-45b8-8314-5d8ca09d645d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:33.142222 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a217b2ee-51e1-45b8-8314-5d8ca09d645d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1574 microversion: 2.1 time: 0.171168 Jul 25 06:05:33.142835 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 529/1032] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:32 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:05:33.421506 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-876d0d5a-1cbc-4a52-8980-de0576b3b5bb tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "POST /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.849749 Jul 25 06:05:33.424865 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 504/1033] 10.222.0.17 () {60 vars in 1322 bytes} [Mon Jul 25 06:05:32 2022] POST /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46/os-volume_attachments => generated 194 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:05:34.159571 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-00293d2a-40a9-4607-87c3-0169303b6bba tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:34.160096 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-00293d2a-40a9-4607-87c3-0169303b6bba tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:34.166706 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-00293d2a-40a9-4607-87c3-0169303b6bba tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:34.167154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-00293d2a-40a9-4607-87c3-0169303b6bba tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:34.168173 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-00293d2a-40a9-4607-87c3-0169303b6bba tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:34.168600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-00293d2a-40a9-4607-87c3-0169303b6bba tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:34.293001 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f3b273b2-a7af-4a8b-a9d8-fee83f49af5d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:34.293860 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f3b273b2-a7af-4a8b-a9d8-fee83f49af5d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:34.300559 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f3b273b2-a7af-4a8b-a9d8-fee83f49af5d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:34.301186 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f3b273b2-a7af-4a8b-a9d8-fee83f49af5d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:34.301955 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f3b273b2-a7af-4a8b-a9d8-fee83f49af5d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:34.302452 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f3b273b2-a7af-4a8b-a9d8-fee83f49af5d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:34.307407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-00293d2a-40a9-4607-87c3-0169303b6bba tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:34.312802 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-00293d2a-40a9-4607-87c3-0169303b6bba tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1574 microversion: 2.1 time: 0.157091 Jul 25 06:05:34.314536 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 530/1034] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:34 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:34.317780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-f3b273b2-a7af-4a8b-a9d8-fee83f49af5d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] HTTP exception thrown: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f3b273b2-a7af-4a8b-a9d8-fee83f49af5d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Request method failure captured: Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: DELETE /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 HTTP/1.1 Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEb7WKhj90_SME0CJ-tXPhbghCaFx2uuZpV8pNIinQO4sRmE3lGwp0m3saWs-iZnHREH481e1y1Psq-ccvxI6HkaheiLRfSxDXJJ56zt-MIjSqwZFiNvokJ9F6bT6TTgBOJy5goqLSHGBvWLqUq5APhQbv4zQGgeA_ijsU77lwEOrs Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: 15678135086b4a5c83eefece6cb8f79a Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:05:34.325324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:05:34.327461 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_15678135086b4a5c83eefece6cb8f79a", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:05:34.327461 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:05:34.327461 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: 15678135086b4a5c83eefece6cb8f79a Jul 25 06:05:34.327461 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:05:34.327461 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-AttachVolumeTestJSON-191392914-project Jul 25 06:05:34.327461 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:05:34.327461 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:05:34.327461 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: dc8b3ecc32c14e31b55156586129a40c Jul 25 06:05:34.327461 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-AttachVolumeTestJSON-191392914-project Jul 25 06:05:34.327461 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:05:34.327461 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. Jul 25 06:05:34.327461 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '0b706acf-4c08-4ea0-8086-3091278ad437'} Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:34.328258 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. Jul 25 06:05:34.329482 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:34.330997 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f3b273b2-a7af-4a8b-a9d8-fee83f49af5d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Returning 404 to user: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:34.330997 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f3b273b2-a7af-4a8b-a9d8-fee83f49af5d tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 404 len: 111 microversion: 2.1 time: 0.040891 Jul 25 06:05:34.330997 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 505/1035] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:05:34 2022] DELETE /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:05:34.335489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6144906c-4c46-492f-84d8-920e22247783 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:34.336160 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6144906c-4c46-492f-84d8-920e22247783 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] [instance: 0b706acf-4c08-4ea0-8086-3091278ad437] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:34.342387 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6144906c-4c46-492f-84d8-920e22247783 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:34.342868 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6144906c-4c46-492f-84d8-920e22247783 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:34.343620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6144906c-4c46-492f-84d8-920e22247783 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:34.344115 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6144906c-4c46-492f-84d8-920e22247783 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:34.358063 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-6144906c-4c46-492f-84d8-920e22247783 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] HTTP exception thrown: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6144906c-4c46-492f-84d8-920e22247783 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Request method failure captured: Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 HTTP/1.1 Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEb7WKhj90_SME0CJ-tXPhbghCaFx2uuZpV8pNIinQO4sRmE3lGwp0m3saWs-iZnHREH481e1y1Psq-ccvxI6HkaheiLRfSxDXJJ56zt-MIjSqwZFiNvokJ9F6bT6TTgBOJy5goqLSHGBvWLqUq5APhQbv4zQGgeA_ijsU77lwEOrs Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 15678135086b4a5c83eefece6cb8f79a Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:05:34.359644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:05:34.361423 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/15678135086b4a5c83eefece6cb8f79a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_15678135086b4a5c83eefece6cb8f79a", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:05:34.361423 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:05:34.361423 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 15678135086b4a5c83eefece6cb8f79a Jul 25 06:05:34.361423 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-AttachVolumeTestJSON-191392914 Jul 25 06:05:34.361423 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-AttachVolumeTestJSON-191392914-project Jul 25 06:05:34.361423 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:05:34.361423 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:05:34.361423 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: dc8b3ecc32c14e31b55156586129a40c Jul 25 06:05:34.361423 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-AttachVolumeTestJSON-191392914-project Jul 25 06:05:34.361423 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:05:34.361423 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. Jul 25 06:05:34.361423 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '0b706acf-4c08-4ea0-8086-3091278ad437'} Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:34.362647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. Jul 25 06:05:34.364049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:34.365540 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6144906c-4c46-492f-84d8-920e22247783 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] Returning 404 to user: Instance 0b706acf-4c08-4ea0-8086-3091278ad437 could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:34.365540 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6144906c-4c46-492f-84d8-920e22247783 tempest-AttachVolumeTestJSON-191392914 tempest-AttachVolumeTestJSON-191392914-project] 10.222.0.17 "GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437" status: 404 len: 111 microversion: 2.1 time: 0.029480 Jul 25 06:05:34.365540 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 531/1036] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:34 2022] GET /compute/v2.1/servers/0b706acf-4c08-4ea0-8086-3091278ad437 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 06:05:35.331051 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3cc4276a-0e7e-41d7-aa29-6433825b394e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:35.332001 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3cc4276a-0e7e-41d7-aa29-6433825b394e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:35.339207 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3cc4276a-0e7e-41d7-aa29-6433825b394e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:35.339668 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3cc4276a-0e7e-41d7-aa29-6433825b394e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:35.340451 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3cc4276a-0e7e-41d7-aa29-6433825b394e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:35.340888 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3cc4276a-0e7e-41d7-aa29-6433825b394e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:35.631203 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3cc4276a-0e7e-41d7-aa29-6433825b394e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:35.639381 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3cc4276a-0e7e-41d7-aa29-6433825b394e tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1574 microversion: 2.1 time: 0.312472 Jul 25 06:05:35.647474 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 506/1037] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:35 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1574 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:36.657490 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ea45c12f-d927-417b-a1a9-9f56373cfb33 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:36.659037 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ea45c12f-d927-417b-a1a9-9f56373cfb33 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:36.662078 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:36.669346 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ea45c12f-d927-417b-a1a9-9f56373cfb33 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:36.670329 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ea45c12f-d927-417b-a1a9-9f56373cfb33 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:36.674048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ea45c12f-d927-417b-a1a9-9f56373cfb33 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:36.675579 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ea45c12f-d927-417b-a1a9-9f56373cfb33 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:36.830214 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ea45c12f-d927-417b-a1a9-9f56373cfb33 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:36.845110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ea45c12f-d927-417b-a1a9-9f56373cfb33 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1574 microversion: 2.1 time: 0.192691 Jul 25 06:05:36.845840 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 532/1038] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:36 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1574 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:37.863450 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f4121353-f73e-41ee-9bf8-a82ab836591d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:37.865032 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f4121353-f73e-41ee-9bf8-a82ab836591d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:37.874916 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f4121353-f73e-41ee-9bf8-a82ab836591d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:37.875362 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f4121353-f73e-41ee-9bf8-a82ab836591d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:37.876138 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f4121353-f73e-41ee-9bf8-a82ab836591d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:37.876566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f4121353-f73e-41ee-9bf8-a82ab836591d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:38.056419 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-f4121353-f73e-41ee-9bf8-a82ab836591d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:38.064465 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f4121353-f73e-41ee-9bf8-a82ab836591d tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1574 microversion: 2.1 time: 0.205564 Jul 25 06:05:38.065080 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 507/1039] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:37 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1574 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:39.081376 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-741eaf92-60e1-4f4b-92b7-319c387258ce tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:39.081992 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-741eaf92-60e1-4f4b-92b7-319c387258ce tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:39.088491 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-741eaf92-60e1-4f4b-92b7-319c387258ce tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:39.088984 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-741eaf92-60e1-4f4b-92b7-319c387258ce tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:39.089709 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-741eaf92-60e1-4f4b-92b7-319c387258ce tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:39.090149 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-741eaf92-60e1-4f4b-92b7-319c387258ce tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:39.238214 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-741eaf92-60e1-4f4b-92b7-319c387258ce tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:39.246263 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-741eaf92-60e1-4f4b-92b7-319c387258ce tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1574 microversion: 2.1 time: 0.168967 Jul 25 06:05:39.247067 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 533/1040] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:39 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:40.264281 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3fc2d33d-b38a-4b19-9315-cebafede44a7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:40.264897 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3fc2d33d-b38a-4b19-9315-cebafede44a7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:40.271544 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3fc2d33d-b38a-4b19-9315-cebafede44a7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:40.272014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3fc2d33d-b38a-4b19-9315-cebafede44a7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:40.272776 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3fc2d33d-b38a-4b19-9315-cebafede44a7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:40.273245 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3fc2d33d-b38a-4b19-9315-cebafede44a7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:40.415587 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3fc2d33d-b38a-4b19-9315-cebafede44a7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:40.423538 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3fc2d33d-b38a-4b19-9315-cebafede44a7 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1574 microversion: 2.1 time: 0.163120 Jul 25 06:05:40.424099 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 508/1041] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:40 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:40.822358 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-481d2853-8fd3-4c9e-b3c9-ce010c06801e req-5b2a78e0-c64e-4cbb-b347-c8198a68467a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1007f9b0-08e2-4d72-91e9-586792d0695b", "name": "network-vif-plugged", "status": "completed", "tag": "3dfa9b78-4afb-4b3a-b13e-7a68f5d8ecc8"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:40.832111 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-481d2853-8fd3-4c9e-b3c9-ce010c06801e req-5b2a78e0-c64e-4cbb-b347-c8198a68467a service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:40.832808 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-481d2853-8fd3-4c9e-b3c9-ce010c06801e req-5b2a78e0-c64e-4cbb-b347-c8198a68467a service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:40.845241 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-481d2853-8fd3-4c9e-b3c9-ce010c06801e req-5b2a78e0-c64e-4cbb-b347-c8198a68467a service nova] Creating event network-vif-plugged:3dfa9b78-4afb-4b3a-b13e-7a68f5d8ecc8 for instance 1007f9b0-08e2-4d72-91e9-586792d0695b on hv-cinder-85083 Jul 25 06:05:40.850834 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-481d2853-8fd3-4c9e-b3c9-ce010c06801e req-5b2a78e0-c64e-4cbb-b347-c8198a68467a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032339 Jul 25 06:05:40.853671 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 534/1042] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:41.136725 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-7f0072d2-7b0f-4b16-a7c6-f426e1b6458b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:41.137283 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-7f0072d2-7b0f-4b16-a7c6-f426e1b6458b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:41.143625 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7f0072d2-7b0f-4b16-a7c6-f426e1b6458b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:41.144073 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7f0072d2-7b0f-4b16-a7c6-f426e1b6458b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:41.144904 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7f0072d2-7b0f-4b16-a7c6-f426e1b6458b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:41.145291 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-7f0072d2-7b0f-4b16-a7c6-f426e1b6458b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:41.267407 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-7f0072d2-7b0f-4b16-a7c6-f426e1b6458b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lazy-loading 'services' on Instance uuid 7fb82501-96de-4841-add9-4628201cca46 {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:05:41.441429 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4589430b-f219-403b-824b-fe2f377c3119 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:41.442437 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4589430b-f219-403b-824b-fe2f377c3119 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:41.449181 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4589430b-f219-403b-824b-fe2f377c3119 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:41.449628 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4589430b-f219-403b-824b-fe2f377c3119 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:41.450382 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4589430b-f219-403b-824b-fe2f377c3119 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:41.450839 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4589430b-f219-403b-824b-fe2f377c3119 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:41.481763 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-7f0072d2-7b0f-4b16-a7c6-f426e1b6458b tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46/os-volume_attachments/401ad31f-9743-4d59-aeef-4dc0edf975ab" status: 202 len: 0 microversion: 2.1 time: 0.349348 Jul 25 06:05:41.482507 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 509/1043] 10.222.0.17 () {58 vars in 1415 bytes} [Mon Jul 25 06:05:41 2022] DELETE /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46/os-volume_attachments/401ad31f-9743-4d59-aeef-4dc0edf975ab => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:05:41.491280 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6ba08fae-fdc3-4eed-b044-2ee65bd8729d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:41.493141 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-6ba08fae-fdc3-4eed-b044-2ee65bd8729d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:41.499874 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6ba08fae-fdc3-4eed-b044-2ee65bd8729d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:41.500322 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6ba08fae-fdc3-4eed-b044-2ee65bd8729d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:41.501093 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6ba08fae-fdc3-4eed-b044-2ee65bd8729d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:41.501516 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6ba08fae-fdc3-4eed-b044-2ee65bd8729d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:41.536080 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-6ba08fae-fdc3-4eed-b044-2ee65bd8729d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048990 Jul 25 06:05:41.536723 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 510/1044] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:41 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:05:41.603574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4589430b-f219-403b-824b-fe2f377c3119 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:41.607079 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:41.611433 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4589430b-f219-403b-824b-fe2f377c3119 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1574 microversion: 2.1 time: 0.174256 Jul 25 06:05:41.611982 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 535/1045] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:41 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:42.548166 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-599673b9-2a45-435c-9935-db03638a40a8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:42.549084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-599673b9-2a45-435c-9935-db03638a40a8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:42.556124 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-599673b9-2a45-435c-9935-db03638a40a8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:42.556566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-599673b9-2a45-435c-9935-db03638a40a8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:42.557356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-599673b9-2a45-435c-9935-db03638a40a8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:42.557815 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-599673b9-2a45-435c-9935-db03638a40a8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:42.587336 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-599673b9-2a45-435c-9935-db03638a40a8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042957 Jul 25 06:05:42.588265 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 511/1046] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:42 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:42.629319 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2a3956f7-93ad-486f-9cca-7e713784c493 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:42.629988 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2a3956f7-93ad-486f-9cca-7e713784c493 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:42.636917 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2a3956f7-93ad-486f-9cca-7e713784c493 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:42.637364 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2a3956f7-93ad-486f-9cca-7e713784c493 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:42.638128 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2a3956f7-93ad-486f-9cca-7e713784c493 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:42.638590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2a3956f7-93ad-486f-9cca-7e713784c493 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:42.790930 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2a3956f7-93ad-486f-9cca-7e713784c493 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:42.802371 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2a3956f7-93ad-486f-9cca-7e713784c493 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1561 microversion: 2.1 time: 0.176977 Jul 25 06:05:42.803257 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 536/1047] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:42 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:43.598985 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e9457689-2712-44b4-bf04-c2393326886f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:43.599914 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e9457689-2712-44b4-bf04-c2393326886f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:43.606872 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e9457689-2712-44b4-bf04-c2393326886f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:43.606970 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e9457689-2712-44b4-bf04-c2393326886f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:43.607740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e9457689-2712-44b4-bf04-c2393326886f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:43.611256 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e9457689-2712-44b4-bf04-c2393326886f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:43.645744 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e9457689-2712-44b4-bf04-c2393326886f tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050582 Jul 25 06:05:43.646708 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 512/1048] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:43 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:44.658222 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-efcbb163-7853-41cd-8df2-0212b79b28d8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:44.658944 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-efcbb163-7853-41cd-8df2-0212b79b28d8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:44.665761 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-efcbb163-7853-41cd-8df2-0212b79b28d8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:44.666216 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-efcbb163-7853-41cd-8df2-0212b79b28d8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:44.667022 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-efcbb163-7853-41cd-8df2-0212b79b28d8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:44.667461 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-efcbb163-7853-41cd-8df2-0212b79b28d8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:44.700519 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-efcbb163-7853-41cd-8df2-0212b79b28d8 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046917 Jul 25 06:05:44.701082 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 537/1049] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:44 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 06:05:44.776684 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-633f5c91-9271-4f5d-aa6d-aac747c31634 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:44.777248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-633f5c91-9271-4f5d-aa6d-aac747c31634 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:44.784358 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-633f5c91-9271-4f5d-aa6d-aac747c31634 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:44.785172 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-633f5c91-9271-4f5d-aa6d-aac747c31634 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:44.786202 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-633f5c91-9271-4f5d-aa6d-aac747c31634 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:44.786888 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-633f5c91-9271-4f5d-aa6d-aac747c31634 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:44.822747 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-633f5c91-9271-4f5d-aa6d-aac747c31634 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Going to try to terminate instance {{(pid=130162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:05:45.125774 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-633f5c91-9271-4f5d-aa6d-aac747c31634 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 204 len: 0 microversion: 2.1 time: 0.353068 Jul 25 06:05:45.126364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 513/1050] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:05:44 2022] DELETE /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:05:45.134719 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-589698da-d972-4e27-acd3-9175b1f28fb2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:45.135357 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-589698da-d972-4e27-acd3-9175b1f28fb2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:45.141218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-589698da-d972-4e27-acd3-9175b1f28fb2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:45.141662 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-589698da-d972-4e27-acd3-9175b1f28fb2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:45.142417 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-589698da-d972-4e27-acd3-9175b1f28fb2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:45.142879 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-589698da-d972-4e27-acd3-9175b1f28fb2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:45.288050 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-589698da-d972-4e27-acd3-9175b1f28fb2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:45.296369 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-589698da-d972-4e27-acd3-9175b1f28fb2 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1680 microversion: 2.1 time: 0.165578 Jul 25 06:05:45.296932 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 538/1051] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:45 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:46.313861 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-56f4c0a7-07c5-400f-adc9-6b533e178f4d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:46.314549 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-56f4c0a7-07c5-400f-adc9-6b533e178f4d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:46.321563 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-56f4c0a7-07c5-400f-adc9-6b533e178f4d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:46.322001 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-56f4c0a7-07c5-400f-adc9-6b533e178f4d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:46.322850 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-56f4c0a7-07c5-400f-adc9-6b533e178f4d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:46.323278 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-56f4c0a7-07c5-400f-adc9-6b533e178f4d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:46.455456 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-56f4c0a7-07c5-400f-adc9-6b533e178f4d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:46.463233 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-56f4c0a7-07c5-400f-adc9-6b533e178f4d tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1680 microversion: 2.1 time: 0.153716 Jul 25 06:05:46.463818 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 514/1052] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:46 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:47.479973 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-dc419f4a-2aa6-460e-9ec2-92251b833d34 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:47.480586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-dc419f4a-2aa6-460e-9ec2-92251b833d34 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:47.487341 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dc419f4a-2aa6-460e-9ec2-92251b833d34 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:47.488012 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dc419f4a-2aa6-460e-9ec2-92251b833d34 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:47.488946 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dc419f4a-2aa6-460e-9ec2-92251b833d34 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:47.489537 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-dc419f4a-2aa6-460e-9ec2-92251b833d34 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:47.556063 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-dc419f4a-2aa6-460e-9ec2-92251b833d34 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:47.564182 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-dc419f4a-2aa6-460e-9ec2-92251b833d34 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1613 microversion: 2.1 time: 0.088032 Jul 25 06:05:47.564839 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 539/1053] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:47 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:47.718187 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-5d5dfcc6-e811-4dcc-857f-02e91ea30f9d req-0ef34bcf-740b-4dee-9f6f-32cf8a4a621f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb82501-96de-4841-add9-4628201cca46", "name": "network-vif-deleted", "tag": "0b4f7f75-6cce-4690-b172-e4721dd570c6"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:47.737785 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-5d5dfcc6-e811-4dcc-857f-02e91ea30f9d req-0ef34bcf-740b-4dee-9f6f-32cf8a4a621f service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:47.738225 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-5d5dfcc6-e811-4dcc-857f-02e91ea30f9d req-0ef34bcf-740b-4dee-9f6f-32cf8a4a621f service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:47.751081 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-5d5dfcc6-e811-4dcc-857f-02e91ea30f9d req-0ef34bcf-740b-4dee-9f6f-32cf8a4a621f service nova] Creating event network-vif-deleted:0b4f7f75-6cce-4690-b172-e4721dd570c6 for instance 7fb82501-96de-4841-add9-4628201cca46 on hv-cinder-85083 Jul 25 06:05:47.756643 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-5d5dfcc6-e811-4dcc-857f-02e91ea30f9d req-0ef34bcf-740b-4dee-9f6f-32cf8a4a621f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042093 Jul 25 06:05:47.757466 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 515/1054] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:48.581261 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3bb4f672-dada-46b0-af53-6ff30d989b13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:48.581872 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-3bb4f672-dada-46b0-af53-6ff30d989b13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:48.589007 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3bb4f672-dada-46b0-af53-6ff30d989b13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:48.589453 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3bb4f672-dada-46b0-af53-6ff30d989b13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:48.590246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3bb4f672-dada-46b0-af53-6ff30d989b13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:48.590750 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3bb4f672-dada-46b0-af53-6ff30d989b13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:48.623220 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3bb4f672-dada-46b0-af53-6ff30d989b13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:48.623680 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3bb4f672-dada-46b0-af53-6ff30d989b13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:48.624186 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.objects.instance [None req-3bb4f672-dada-46b0-af53-6ff30d989b13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lazy-loading 'fault' on Instance uuid 7fb82501-96de-4841-add9-4628201cca46 {{(pid=130163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:05:48.676252 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3bb4f672-dada-46b0-af53-6ff30d989b13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc49525e3394668b4f1610c4badc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488e87a8233e4e69a07cd8efba37cad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:48.685598 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-3bb4f672-dada-46b0-af53-6ff30d989b13 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 200 len: 1331 microversion: 2.1 time: 0.107800 Jul 25 06:05:48.691006 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 540/1055] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:48 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:49.712562 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f32933d5-13f2-4f33-a616-5805c1d0349a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:49.713264 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f32933d5-13f2-4f33-a616-5805c1d0349a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:49.719752 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f32933d5-13f2-4f33-a616-5805c1d0349a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:49.720193 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f32933d5-13f2-4f33-a616-5805c1d0349a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:49.721059 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f32933d5-13f2-4f33-a616-5805c1d0349a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:49.721490 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f32933d5-13f2-4f33-a616-5805c1d0349a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:49.725723 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:49.735338 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-f32933d5-13f2-4f33-a616-5805c1d0349a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] HTTP exception thrown: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f32933d5-13f2-4f33-a616-5805c1d0349a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Request method failure captured: Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 HTTP/1.1 Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEaup3unl7LzCcXgiLIPWZjrIYFX_SDw7ELDXjOyj6m1AigSppJN7j_MZUlx8A8dXfMKGKjZXWqF1YnEL3IukuRzY_02IDqinPYsk5il0dKKd6-RpE31D5qPeu1-2vVhe6F2MsA703sX0YNFO-wEG6wXFh49_JEAsgi8VdOlbOfuBo Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:05:49.736977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:05:49.738632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_488e87a8233e4e69a07cd8efba37cad7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:05:49.738632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:49.738632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:49.738632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:49.738632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:49.738632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:05:49.738632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:05:49.738632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 6dc49525e3394668b4f1610c4badc144 Jul 25 06:05:49.738632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:49.738632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:05:49.738632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. Jul 25 06:05:49.738632 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '7fb82501-96de-4841-add9-4628201cca46'} Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:49.739440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. Jul 25 06:05:49.740712 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:49.741800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f32933d5-13f2-4f33-a616-5805c1d0349a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Returning 404 to user: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:49.741800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f32933d5-13f2-4f33-a616-5805c1d0349a tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 404 len: 111 microversion: 2.1 time: 0.034673 Jul 25 06:05:49.741800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 516/1056] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:49 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:05:49.747902 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-1dcc9af5-17e7-4683-8fb1-e23699dffc9e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '.version_select at 0x7f9d36172790>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:49.834452 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-1dcc9af5-17e7-4683-8fb1-e23699dffc9e tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-991426566" status: 202 len: 0 microversion: 2.1 time: 0.090318 Jul 25 06:05:49.835076 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 541/1057] 10.222.0.17 () {58 vars in 1217 bytes} [Mon Jul 25 06:05:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-991426566 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:05:51.883847 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cee99644-cdd5-49ba-9f8f-f4e1e8d60ccb tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:51.884243 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-cee99644-cdd5-49ba-9f8f-f4e1e8d60ccb tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:51.891059 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cee99644-cdd5-49ba-9f8f-f4e1e8d60ccb tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:51.891514 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cee99644-cdd5-49ba-9f8f-f4e1e8d60ccb tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:51.892288 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cee99644-cdd5-49ba-9f8f-f4e1e8d60ccb tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:51.892856 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cee99644-cdd5-49ba-9f8f-f4e1e8d60ccb tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-cee99644-cdd5-49ba-9f8f-f4e1e8d60ccb tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] HTTP exception thrown: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cee99644-cdd5-49ba-9f8f-f4e1e8d60ccb tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Request method failure captured: Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: DELETE /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 HTTP/1.1 Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEaup3unl7LzCcXgiLIPWZjrIYFX_SDw7ELDXjOyj6m1AigSppJN7j_MZUlx8A8dXfMKGKjZXWqF1YnEL3IukuRzY_02IDqinPYsk5il0dKKd6-RpE31D5qPeu1-2vVhe6F2MsA703sX0YNFO-wEG6wXFh49_JEAsgi8VdOlbOfuBo Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:05:51.912119 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:05:51.913855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_488e87a8233e4e69a07cd8efba37cad7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:05:51.913855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:51.913855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:51.913855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:51.913855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:51.913855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:05:51.913855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:05:51.913855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 6dc49525e3394668b4f1610c4badc144 Jul 25 06:05:51.913855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:51.913855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:05:51.913855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. Jul 25 06:05:51.913855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '7fb82501-96de-4841-add9-4628201cca46'} Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:51.914913 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. Jul 25 06:05:51.916356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:51.918541 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cee99644-cdd5-49ba-9f8f-f4e1e8d60ccb tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Returning 404 to user: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:51.918541 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-cee99644-cdd5-49ba-9f8f-f4e1e8d60ccb tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 404 len: 111 microversion: 2.1 time: 0.035217 Jul 25 06:05:51.918541 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 517/1058] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:05:51 2022] DELETE /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:05:51.924389 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5adc47a1-2b01-4f2f-932b-f4b30f2961b5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:51.925008 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5adc47a1-2b01-4f2f-932b-f4b30f2961b5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 7fb82501-96de-4841-add9-4628201cca46] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:51.931508 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5adc47a1-2b01-4f2f-932b-f4b30f2961b5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:51.931981 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5adc47a1-2b01-4f2f-932b-f4b30f2961b5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:51.932734 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5adc47a1-2b01-4f2f-932b-f4b30f2961b5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:51.933167 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5adc47a1-2b01-4f2f-932b-f4b30f2961b5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:51.946413 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-5adc47a1-2b01-4f2f-932b-f4b30f2961b5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] HTTP exception thrown: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5adc47a1-2b01-4f2f-932b-f4b30f2961b5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Request method failure captured: Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 HTTP/1.1 Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEaup3unl7LzCcXgiLIPWZjrIYFX_SDw7ELDXjOyj6m1AigSppJN7j_MZUlx8A8dXfMKGKjZXWqF1YnEL3IukuRzY_02IDqinPYsk5il0dKKd6-RpE31D5qPeu1-2vVhe6F2MsA703sX0YNFO-wEG6wXFh49_JEAsgi8VdOlbOfuBo Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:05:51.948143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:05:51.949717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_488e87a8233e4e69a07cd8efba37cad7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:05:51.949717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:51.949717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:51.949717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:51.949717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:51.949717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:05:51.949717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:05:51.949717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 6dc49525e3394668b4f1610c4badc144 Jul 25 06:05:51.949717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:51.949717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:05:51.949717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. Jul 25 06:05:51.949717 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '7fb82501-96de-4841-add9-4628201cca46'} Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:51.953829 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. Jul 25 06:05:51.955218 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:51.956741 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5adc47a1-2b01-4f2f-932b-f4b30f2961b5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Returning 404 to user: Instance 7fb82501-96de-4841-add9-4628201cca46 could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:51.956741 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5adc47a1-2b01-4f2f-932b-f4b30f2961b5 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46" status: 404 len: 111 microversion: 2.1 time: 0.029682 Jul 25 06:05:51.956741 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 542/1059] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:51 2022] GET /compute/v2.1/servers/7fb82501-96de-4841-add9-4628201cca46 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:05:53.247832 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-629b36cd-24f8-462b-9c99-655292a004ae tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:53.248435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-629b36cd-24f8-462b-9c99-655292a004ae tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:53.251140 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:53.256584 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-629b36cd-24f8-462b-9c99-655292a004ae tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:53.257036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-629b36cd-24f8-462b-9c99-655292a004ae tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:53.257794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-629b36cd-24f8-462b-9c99-655292a004ae tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:53.258865 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-629b36cd-24f8-462b-9c99-655292a004ae tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:53.275254 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-629b36cd-24f8-462b-9c99-655292a004ae tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] HTTP exception thrown: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-629b36cd-24f8-462b-9c99-655292a004ae tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Request method failure captured: Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: DELETE /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 HTTP/1.1 Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEaup3unl7LzCcXgiLIPWZjrIYFX_SDw7ELDXjOyj6m1AigSppJN7j_MZUlx8A8dXfMKGKjZXWqF1YnEL3IukuRzY_02IDqinPYsk5il0dKKd6-RpE31D5qPeu1-2vVhe6F2MsA703sX0YNFO-wEG6wXFh49_JEAsgi8VdOlbOfuBo Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:05:53.276735 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:05:53.278406 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_488e87a8233e4e69a07cd8efba37cad7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:05:53.278406 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:53.278406 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:53.278406 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:53.278406 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:53.278406 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:05:53.278406 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:05:53.278406 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 6dc49525e3394668b4f1610c4badc144 Jul 25 06:05:53.278406 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:53.278406 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:05:53.278406 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. Jul 25 06:05:53.278406 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': 'a277f58b-99c2-4b07-a838-9f45f9009f92'} Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:53.280068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. Jul 25 06:05:53.281740 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.283306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-629b36cd-24f8-462b-9c99-655292a004ae tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Returning 404 to user: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:53.283306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-629b36cd-24f8-462b-9c99-655292a004ae tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 404 len: 111 microversion: 2.1 time: 0.035351 Jul 25 06:05:53.283306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 518/1060] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:05:53 2022] DELETE /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 06:05:53.286861 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-21887ef7-d5a4-4b15-9025-9bed01837485 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:53.287510 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-21887ef7-d5a4-4b15-9025-9bed01837485 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: a277f58b-99c2-4b07-a838-9f45f9009f92] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:53.294557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-21887ef7-d5a4-4b15-9025-9bed01837485 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:53.295015 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-21887ef7-d5a4-4b15-9025-9bed01837485 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:53.295783 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-21887ef7-d5a4-4b15-9025-9bed01837485 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:53.296253 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-21887ef7-d5a4-4b15-9025-9bed01837485 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:53.309239 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-21887ef7-d5a4-4b15-9025-9bed01837485 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] HTTP exception thrown: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-21887ef7-d5a4-4b15-9025-9bed01837485 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Request method failure captured: Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 HTTP/1.1 Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEaup3unl7LzCcXgiLIPWZjrIYFX_SDw7ELDXjOyj6m1AigSppJN7j_MZUlx8A8dXfMKGKjZXWqF1YnEL3IukuRzY_02IDqinPYsk5il0dKKd6-RpE31D5qPeu1-2vVhe6F2MsA703sX0YNFO-wEG6wXFh49_JEAsgi8VdOlbOfuBo Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:05:53.310880 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:05:53.312920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_488e87a8233e4e69a07cd8efba37cad7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:05:53.312920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:53.312920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:53.312920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:53.312920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:53.312920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:05:53.312920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:05:53.312920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 6dc49525e3394668b4f1610c4badc144 Jul 25 06:05:53.312920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:53.312920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:05:53.312920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. Jul 25 06:05:53.312920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': 'a277f58b-99c2-4b07-a838-9f45f9009f92'} Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:53.313964 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. Jul 25 06:05:53.315693 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.317147 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-21887ef7-d5a4-4b15-9025-9bed01837485 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Returning 404 to user: Instance a277f58b-99c2-4b07-a838-9f45f9009f92 could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:53.317147 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-21887ef7-d5a4-4b15-9025-9bed01837485 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92" status: 404 len: 111 microversion: 2.1 time: 0.029613 Jul 25 06:05:53.317147 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 543/1061] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:53 2022] GET /compute/v2.1/servers/a277f58b-99c2-4b07-a838-9f45f9009f92 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:05:53.324476 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d624837c-7f86-486b-a177-0a71ef7ba852 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:53.324975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d624837c-7f86-486b-a177-0a71ef7ba852 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:53.331044 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d624837c-7f86-486b-a177-0a71ef7ba852 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:53.331489 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d624837c-7f86-486b-a177-0a71ef7ba852 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:53.332245 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d624837c-7f86-486b-a177-0a71ef7ba852 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:53.332681 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d624837c-7f86-486b-a177-0a71ef7ba852 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:53.346464 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-d624837c-7f86-486b-a177-0a71ef7ba852 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] HTTP exception thrown: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d624837c-7f86-486b-a177-0a71ef7ba852 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Request method failure captured: Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: DELETE /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff HTTP/1.1 Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEaup3unl7LzCcXgiLIPWZjrIYFX_SDw7ELDXjOyj6m1AigSppJN7j_MZUlx8A8dXfMKGKjZXWqF1YnEL3IukuRzY_02IDqinPYsk5il0dKKd6-RpE31D5qPeu1-2vVhe6F2MsA703sX0YNFO-wEG6wXFh49_JEAsgi8VdOlbOfuBo Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:05:53.348014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:05:53.349521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_488e87a8233e4e69a07cd8efba37cad7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:05:53.349521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:53.349521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:53.349521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:53.349521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:53.349521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:05:53.349521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:05:53.349521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 6dc49525e3394668b4f1610c4badc144 Jul 25 06:05:53.349521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:53.349521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:05:53.349521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. Jul 25 06:05:53.349521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': 'fb485129-6941-49db-9cee-c83f53f2bdff'} Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:53.350435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. Jul 25 06:05:53.351820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.353162 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d624837c-7f86-486b-a177-0a71ef7ba852 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Returning 404 to user: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:53.353162 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d624837c-7f86-486b-a177-0a71ef7ba852 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 404 len: 111 microversion: 2.1 time: 0.032211 Jul 25 06:05:53.353162 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 519/1062] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:05:53 2022] DELETE /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:05:53.357830 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-66512b9d-8341-46ec-8630-50c09a35d02c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:53.358443 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-66512b9d-8341-46ec-8630-50c09a35d02c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: fb485129-6941-49db-9cee-c83f53f2bdff] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:53.364568 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-66512b9d-8341-46ec-8630-50c09a35d02c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:53.365019 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-66512b9d-8341-46ec-8630-50c09a35d02c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:53.365776 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-66512b9d-8341-46ec-8630-50c09a35d02c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:53.366242 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-66512b9d-8341-46ec-8630-50c09a35d02c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:53.379246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-66512b9d-8341-46ec-8630-50c09a35d02c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] HTTP exception thrown: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-66512b9d-8341-46ec-8630-50c09a35d02c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Request method failure captured: Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff HTTP/1.1 Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEaup3unl7LzCcXgiLIPWZjrIYFX_SDw7ELDXjOyj6m1AigSppJN7j_MZUlx8A8dXfMKGKjZXWqF1YnEL3IukuRzY_02IDqinPYsk5il0dKKd6-RpE31D5qPeu1-2vVhe6F2MsA703sX0YNFO-wEG6wXFh49_JEAsgi8VdOlbOfuBo Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:05:53.380812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:05:53.382350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_488e87a8233e4e69a07cd8efba37cad7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:05:53.382350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:53.382350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:53.382350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:53.382350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:53.382350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:05:53.382350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:05:53.382350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 6dc49525e3394668b4f1610c4badc144 Jul 25 06:05:53.382350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:53.382350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:05:53.382350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. Jul 25 06:05:53.382350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': 'fb485129-6941-49db-9cee-c83f53f2bdff'} Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:53.383941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. Jul 25 06:05:53.385360 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:53.386879 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-66512b9d-8341-46ec-8630-50c09a35d02c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Returning 404 to user: Instance fb485129-6941-49db-9cee-c83f53f2bdff could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:53.386879 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-66512b9d-8341-46ec-8630-50c09a35d02c tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff" status: 404 len: 111 microversion: 2.1 time: 0.028201 Jul 25 06:05:53.386879 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 544/1063] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:53 2022] GET /compute/v2.1/servers/fb485129-6941-49db-9cee-c83f53f2bdff => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:05:54.736279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9d3aa4d3-6118-424b-8434-60da5d1ab004 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:54.736786 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-9d3aa4d3-6118-424b-8434-60da5d1ab004 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:54.744207 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9d3aa4d3-6118-424b-8434-60da5d1ab004 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:54.747191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9d3aa4d3-6118-424b-8434-60da5d1ab004 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:54.747191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9d3aa4d3-6118-424b-8434-60da5d1ab004 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:54.747191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9d3aa4d3-6118-424b-8434-60da5d1ab004 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:54.763693 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-9d3aa4d3-6118-424b-8434-60da5d1ab004 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] HTTP exception thrown: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9d3aa4d3-6118-424b-8434-60da5d1ab004 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Request method failure captured: Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: DELETE /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f HTTP/1.1 Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEaup3unl7LzCcXgiLIPWZjrIYFX_SDw7ELDXjOyj6m1AigSppJN7j_MZUlx8A8dXfMKGKjZXWqF1YnEL3IukuRzY_02IDqinPYsk5il0dKKd6-RpE31D5qPeu1-2vVhe6F2MsA703sX0YNFO-wEG6wXFh49_JEAsgi8VdOlbOfuBo Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:05:54.765263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:05:54.766609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_488e87a8233e4e69a07cd8efba37cad7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:05:54.766609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:54.766609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:54.766609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:54.766609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:54.766609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:05:54.766609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:05:54.766609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 6dc49525e3394668b4f1610c4badc144 Jul 25 06:05:54.766609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:54.766609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:05:54.766609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. Jul 25 06:05:54.766609 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '479a7885-4c31-448b-8d0d-42049d47896f'} Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:54.771276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. Jul 25 06:05:54.772498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:05:54.773682 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9d3aa4d3-6118-424b-8434-60da5d1ab004 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Returning 404 to user: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:54.773682 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-9d3aa4d3-6118-424b-8434-60da5d1ab004 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "DELETE /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 404 len: 111 microversion: 2.1 time: 0.037106 Jul 25 06:05:54.773682 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 520/1064] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:05:54 2022] DELETE /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 06:05:54.777657 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ae8087d4-e879-40bb-97fa-7de02c3f1f56 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:54.778267 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ae8087d4-e879-40bb-97fa-7de02c3f1f56 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] [instance: 479a7885-4c31-448b-8d0d-42049d47896f] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:54.784729 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ae8087d4-e879-40bb-97fa-7de02c3f1f56 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:54.785174 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ae8087d4-e879-40bb-97fa-7de02c3f1f56 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:54.785962 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ae8087d4-e879-40bb-97fa-7de02c3f1f56 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:54.786394 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ae8087d4-e879-40bb-97fa-7de02c3f1f56 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:54.800529 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-ae8087d4-e879-40bb-97fa-7de02c3f1f56 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] HTTP exception thrown: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ae8087d4-e879-40bb-97fa-7de02c3f1f56 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Request method failure captured: Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f HTTP/1.1 Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEaup3unl7LzCcXgiLIPWZjrIYFX_SDw7ELDXjOyj6m1AigSppJN7j_MZUlx8A8dXfMKGKjZXWqF1YnEL3IukuRzY_02IDqinPYsk5il0dKKd6-RpE31D5qPeu1-2vVhe6F2MsA703sX0YNFO-wEG6wXFh49_JEAsgi8VdOlbOfuBo Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:05:54.802137 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:05:54.803736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/488e87a8233e4e69a07cd8efba37cad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_488e87a8233e4e69a07cd8efba37cad7", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:05:54.803736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:54.803736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 488e87a8233e4e69a07cd8efba37cad7 Jul 25 06:05:54.803736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1186333280 Jul 25 06:05:54.803736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:54.803736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:05:54.803736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:05:54.803736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 6dc49525e3394668b4f1610c4badc144 Jul 25 06:05:54.803736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-AttachVolumeNegativeTest-1186333280-project Jul 25 06:05:54.803736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:05:54.803736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. Jul 25 06:05:54.803736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '479a7885-4c31-448b-8d0d-42049d47896f'} Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:54.804566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. Jul 25 06:05:54.806029 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:05:54.807190 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ae8087d4-e879-40bb-97fa-7de02c3f1f56 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] Returning 404 to user: Instance 479a7885-4c31-448b-8d0d-42049d47896f could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:54.807190 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ae8087d4-e879-40bb-97fa-7de02c3f1f56 tempest-AttachVolumeNegativeTest-1186333280 tempest-AttachVolumeNegativeTest-1186333280-project] 10.222.0.17 "GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f" status: 404 len: 111 microversion: 2.1 time: 0.030434 Jul 25 06:05:54.807190 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 545/1065] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:54 2022] GET /compute/v2.1/servers/479a7885-4c31-448b-8d0d-42049d47896f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:06:05.066765 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-112c9ce5-d6a4-4cc2-b44f-c0985cdd589b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:05.067854 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-112c9ce5-d6a4-4cc2-b44f-c0985cdd589b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:05.071326 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=8 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:06:05.076165 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-112c9ce5-d6a4-4cc2-b44f-c0985cdd589b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:05.076626 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-112c9ce5-d6a4-4cc2-b44f-c0985cdd589b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:05.077384 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-112c9ce5-d6a4-4cc2-b44f-c0985cdd589b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:05.077974 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-112c9ce5-d6a4-4cc2-b44f-c0985cdd589b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:05.108288 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-112c9ce5-d6a4-4cc2-b44f-c0985cdd589b tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045596 Jul 25 06:06:05.113499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 521/1066] 10.222.0.17 () {60 vars in 1342 bytes} [Mon Jul 25 06:06:05 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:05.167692 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-e591ec62-4a1d-4a92-8510-b0b04251cabc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:05.170582 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e591ec62-4a1d-4a92-8510-b0b04251cabc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:05.171163 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:06:05.171827 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=40 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:06:05.176747 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e591ec62-4a1d-4a92-8510-b0b04251cabc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:05.177205 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e591ec62-4a1d-4a92-8510-b0b04251cabc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:05.177985 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e591ec62-4a1d-4a92-8510-b0b04251cabc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:05.178424 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-e591ec62-4a1d-4a92-8510-b0b04251cabc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:05.206122 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-e591ec62-4a1d-4a92-8510-b0b04251cabc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Going to try to terminate instance {{(pid=130163) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:06:05.565162 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-e591ec62-4a1d-4a92-8510-b0b04251cabc tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "DELETE /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 204 len: 0 microversion: 2.20 time: 0.401074 Jul 25 06:06:05.565934 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 546/1067] 10.222.0.17 () {60 vars in 1279 bytes} [Mon Jul 25 06:06:05 2022] DELETE /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 06:06:05.575851 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-72dae8d4-baae-45da-85a0-6261e2f7dfe8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:05.575851 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-72dae8d4-baae-45da-85a0-6261e2f7dfe8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:05.582141 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-72dae8d4-baae-45da-85a0-6261e2f7dfe8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:05.582619 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-72dae8d4-baae-45da-85a0-6261e2f7dfe8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:05.583380 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-72dae8d4-baae-45da-85a0-6261e2f7dfe8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:05.583986 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-72dae8d4-baae-45da-85a0-6261e2f7dfe8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:05.721256 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-72dae8d4-baae-45da-85a0-6261e2f7dfe8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:05.729991 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-72dae8d4-baae-45da-85a0-6261e2f7dfe8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:05.732030 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-72dae8d4-baae-45da-85a0-6261e2f7dfe8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:05.733596 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-72dae8d4-baae-45da-85a0-6261e2f7dfe8 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1723 microversion: 2.20 time: 0.163316 Jul 25 06:06:05.734405 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 522/1068] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:05 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:06:06.752892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6a11d2b3-ae92-4253-bba3-7bc09c2898c6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:06.753538 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6a11d2b3-ae92-4253-bba3-7bc09c2898c6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:06.760534 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6a11d2b3-ae92-4253-bba3-7bc09c2898c6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:06.760987 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6a11d2b3-ae92-4253-bba3-7bc09c2898c6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:06.761934 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6a11d2b3-ae92-4253-bba3-7bc09c2898c6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:06.762660 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6a11d2b3-ae92-4253-bba3-7bc09c2898c6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:06.909280 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6a11d2b3-ae92-4253-bba3-7bc09c2898c6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:06.919405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6a11d2b3-ae92-4253-bba3-7bc09c2898c6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:06.922740 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6a11d2b3-ae92-4253-bba3-7bc09c2898c6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:06.925064 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6a11d2b3-ae92-4253-bba3-7bc09c2898c6 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1723 microversion: 2.20 time: 0.176016 Jul 25 06:06:06.926140 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 547/1069] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:06 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:06:07.944502 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-014c9f91-fe0d-45d4-8d96-a4c29f2af994 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:07.945054 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-014c9f91-fe0d-45d4-8d96-a4c29f2af994 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:07.953802 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-014c9f91-fe0d-45d4-8d96-a4c29f2af994 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:07.953802 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-014c9f91-fe0d-45d4-8d96-a4c29f2af994 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:07.953802 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-014c9f91-fe0d-45d4-8d96-a4c29f2af994 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:07.953802 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-014c9f91-fe0d-45d4-8d96-a4c29f2af994 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:08.014034 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-34e98515-934b-486c-b4f1-40404a5ced85 req-7f5073a3-6371-4832-92dd-eae80d4108ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339de78a-2525-478a-842f-faea8fc424e2", "name": "network-vif-deleted", "tag": "5f811af2-0e22-4934-ac4e-1b3da227067b"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:06:08.035872 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-014c9f91-fe0d-45d4-8d96-a4c29f2af994 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:08.041022 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-34e98515-934b-486c-b4f1-40404a5ced85 req-7f5073a3-6371-4832-92dd-eae80d4108ea service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:08.043255 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-34e98515-934b-486c-b4f1-40404a5ced85 req-7f5073a3-6371-4832-92dd-eae80d4108ea service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:08.047569 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-014c9f91-fe0d-45d4-8d96-a4c29f2af994 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:08.050004 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-014c9f91-fe0d-45d4-8d96-a4c29f2af994 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:08.052129 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-014c9f91-fe0d-45d4-8d96-a4c29f2af994 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1655 microversion: 2.20 time: 0.111772 Jul 25 06:06:08.053233 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 523/1070] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:07 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1655 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:06:08.059211 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-34e98515-934b-486c-b4f1-40404a5ced85 req-7f5073a3-6371-4832-92dd-eae80d4108ea service nova] Creating event network-vif-deleted:5f811af2-0e22-4934-ac4e-1b3da227067b for instance 339de78a-2525-478a-842f-faea8fc424e2 on hv-cinder-85083 Jul 25 06:06:08.064765 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-34e98515-934b-486c-b4f1-40404a5ced85 req-7f5073a3-6371-4832-92dd-eae80d4108ea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062230 Jul 25 06:06:08.066615 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 548/1071] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:06:09.071024 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8fd58324-7d23-43e8-8788-c0e9930769ed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:09.074851 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8fd58324-7d23-43e8-8788-c0e9930769ed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:09.082763 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8fd58324-7d23-43e8-8788-c0e9930769ed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:09.082763 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8fd58324-7d23-43e8-8788-c0e9930769ed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:09.083630 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8fd58324-7d23-43e8-8788-c0e9930769ed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:09.084072 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8fd58324-7d23-43e8-8788-c0e9930769ed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:09.119452 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8fd58324-7d23-43e8-8788-c0e9930769ed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:09.135771 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8fd58324-7d23-43e8-8788-c0e9930769ed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:09.136576 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-8fd58324-7d23-43e8-8788-c0e9930769ed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lazy-loading 'fault' on Instance uuid 339de78a-2525-478a-842f-faea8fc424e2 {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:06:09.198999 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8fd58324-7d23-43e8-8788-c0e9930769ed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:09.234760 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8fd58324-7d23-43e8-8788-c0e9930769ed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:09.234760 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8fd58324-7d23-43e8-8788-c0e9930769ed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f269cd38f734209ba0496cf70469608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45136a1cdbf4e93b9cf71d33443220f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:09.234760 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-8fd58324-7d23-43e8-8788-c0e9930769ed tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 200 len: 1371 microversion: 2.20 time: 0.157820 Jul 25 06:06:09.235242 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 524/1072] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:09 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:06:10.243573 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d31d6704-9bd6-4da0-b8b5-fd55bec8d0fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:10.244348 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d31d6704-9bd6-4da0-b8b5-fd55bec8d0fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:10.251104 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d31d6704-9bd6-4da0-b8b5-fd55bec8d0fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:10.252754 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d31d6704-9bd6-4da0-b8b5-fd55bec8d0fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:10.253530 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d31d6704-9bd6-4da0-b8b5-fd55bec8d0fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:10.253969 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d31d6704-9bd6-4da0-b8b5-fd55bec8d0fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:10.267288 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-d31d6704-9bd6-4da0-b8b5-fd55bec8d0fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] HTTP exception thrown: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d31d6704-9bd6-4da0-b8b5-fd55bec8d0fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Request method failure captured: Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 HTTP/1.1 Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEa3EM2d9zEpyK_f0kc4EkyDsQlwrxNJdez4UzHU68PFTaMda9jI7BibFba4S5DwSN3V7rcTy7nu_z4oyIcJ7303PdZcPYWaKqFv-xSS5Pi4EpifltyA5Q4bOMuwrk6PZXf5prPBFVwmuKuTTlnOPPTNHxSfV--zUVfDdnTLphiAc4 Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: d45136a1cdbf4e93b9cf71d33443220f Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:06:10.268947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:06:10.270651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d45136a1cdbf4e93b9cf71d33443220f", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:06:10.270651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:06:10.270651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: d45136a1cdbf4e93b9cf71d33443220f Jul 25 06:06:10.270651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:06:10.270651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-AttachVolumeShelveTestJSON-981251187-project Jul 25 06:06:10.270651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:06:10.270651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:06:10.270651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 7f269cd38f734209ba0496cf70469608 Jul 25 06:06:10.270651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-AttachVolumeShelveTestJSON-981251187-project Jul 25 06:06:10.270651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:06:10.270651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. Jul 25 06:06:10.270651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '339de78a-2525-478a-842f-faea8fc424e2'} Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:10.275563 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. Jul 25 06:06:10.277048 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:10.278510 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d31d6704-9bd6-4da0-b8b5-fd55bec8d0fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Returning 404 to user: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:10.278510 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d31d6704-9bd6-4da0-b8b5-fd55bec8d0fa tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 404 len: 111 microversion: 2.20 time: 0.031456 Jul 25 06:06:10.278510 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 549/1073] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:10 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 06:06:10.280326 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-10d85d72-b5d5-44f1-abc8-48f2eac57bf1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '.version_select at 0x7f9d36a51790>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:10.338739 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-10d85d72-b5d5-44f1-abc8-48f2eac57bf1 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-622850988" status: 204 len: 0 microversion: 2.20 time: 0.062552 Jul 25 06:06:10.339429 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 525/1074] 10.222.0.17 () {60 vars in 1258 bytes} [Mon Jul 25 06:06:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-622850988 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 06:06:12.479950 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a258c75e-1868-415c-989f-70094e95ec5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:12.485225 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a258c75e-1868-415c-989f-70094e95ec5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:12.486989 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a258c75e-1868-415c-989f-70094e95ec5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:12.487442 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a258c75e-1868-415c-989f-70094e95ec5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:12.488213 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a258c75e-1868-415c-989f-70094e95ec5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:12.488652 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a258c75e-1868-415c-989f-70094e95ec5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:12.502040 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-a258c75e-1868-415c-989f-70094e95ec5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] HTTP exception thrown: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a258c75e-1868-415c-989f-70094e95ec5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Request method failure captured: Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: DELETE /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 HTTP/1.1 Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEa3EM2d9zEpyK_f0kc4EkyDsQlwrxNJdez4UzHU68PFTaMda9jI7BibFba4S5DwSN3V7rcTy7nu_z4oyIcJ7303PdZcPYWaKqFv-xSS5Pi4EpifltyA5Q4bOMuwrk6PZXf5prPBFVwmuKuTTlnOPPTNHxSfV--zUVfDdnTLphiAc4 Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: d45136a1cdbf4e93b9cf71d33443220f Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:06:12.503620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:06:12.505318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d45136a1cdbf4e93b9cf71d33443220f", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:06:12.505318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:06:12.505318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: d45136a1cdbf4e93b9cf71d33443220f Jul 25 06:06:12.505318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:06:12.505318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-AttachVolumeShelveTestJSON-981251187-project Jul 25 06:06:12.505318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:06:12.505318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:06:12.505318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 7f269cd38f734209ba0496cf70469608 Jul 25 06:06:12.505318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-AttachVolumeShelveTestJSON-981251187-project Jul 25 06:06:12.505318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:06:12.505318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. Jul 25 06:06:12.505318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '339de78a-2525-478a-842f-faea8fc424e2'} Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:12.506290 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. Jul 25 06:06:12.507590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:12.508872 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a258c75e-1868-415c-989f-70094e95ec5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Returning 404 to user: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:12.508872 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a258c75e-1868-415c-989f-70094e95ec5e tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "DELETE /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 404 len: 111 microversion: 2.20 time: 0.029671 Jul 25 06:06:12.508872 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 550/1075] 10.222.0.17 () {60 vars in 1279 bytes} [Mon Jul 25 06:06:12 2022] DELETE /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 06:06:12.514098 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8da46fda-d78f-4a33-bf27-584a470875cf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:12.514744 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8da46fda-d78f-4a33-bf27-584a470875cf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 339de78a-2525-478a-842f-faea8fc424e2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:12.521172 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8da46fda-d78f-4a33-bf27-584a470875cf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:12.521617 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8da46fda-d78f-4a33-bf27-584a470875cf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:12.522360 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8da46fda-d78f-4a33-bf27-584a470875cf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:12.522906 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8da46fda-d78f-4a33-bf27-584a470875cf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:12.536163 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-8da46fda-d78f-4a33-bf27-584a470875cf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] HTTP exception thrown: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8da46fda-d78f-4a33-bf27-584a470875cf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Request method failure captured: Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 HTTP/1.1 Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEa3EM2d9zEpyK_f0kc4EkyDsQlwrxNJdez4UzHU68PFTaMda9jI7BibFba4S5DwSN3V7rcTy7nu_z4oyIcJ7303PdZcPYWaKqFv-xSS5Pi4EpifltyA5Q4bOMuwrk6PZXf5prPBFVwmuKuTTlnOPPTNHxSfV--zUVfDdnTLphiAc4 Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: d45136a1cdbf4e93b9cf71d33443220f Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:06:12.537660 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:06:12.539306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d45136a1cdbf4e93b9cf71d33443220f", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:06:12.539306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:06:12.539306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: d45136a1cdbf4e93b9cf71d33443220f Jul 25 06:06:12.539306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:06:12.539306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-AttachVolumeShelveTestJSON-981251187-project Jul 25 06:06:12.539306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:06:12.539306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:06:12.539306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 7f269cd38f734209ba0496cf70469608 Jul 25 06:06:12.539306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-AttachVolumeShelveTestJSON-981251187-project Jul 25 06:06:12.539306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:06:12.539306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. Jul 25 06:06:12.539306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '339de78a-2525-478a-842f-faea8fc424e2'} Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:12.540855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. Jul 25 06:06:12.542374 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:12.544042 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8da46fda-d78f-4a33-bf27-584a470875cf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Returning 404 to user: Instance 339de78a-2525-478a-842f-faea8fc424e2 could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:12.544042 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-8da46fda-d78f-4a33-bf27-584a470875cf tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2" status: 404 len: 111 microversion: 2.20 time: 0.029321 Jul 25 06:06:12.544042 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 526/1076] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:12 2022] GET /compute/v2.1/servers/339de78a-2525-478a-842f-faea8fc424e2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 06:06:15.957637 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ee2d9dbf-df8a-4caf-933a-490f66311386 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:15.958220 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ee2d9dbf-df8a-4caf-933a-490f66311386 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:15.965838 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ee2d9dbf-df8a-4caf-933a-490f66311386 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:15.966435 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ee2d9dbf-df8a-4caf-933a-490f66311386 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:15.967225 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ee2d9dbf-df8a-4caf-933a-490f66311386 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:15.967724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-ee2d9dbf-df8a-4caf-933a-490f66311386 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:15.986298 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-ee2d9dbf-df8a-4caf-933a-490f66311386 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] HTTP exception thrown: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ee2d9dbf-df8a-4caf-933a-490f66311386 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Request method failure captured: Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: DELETE /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 HTTP/1.1 Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jEa3EM2d9zEpyK_f0kc4EkyDsQlwrxNJdez4UzHU68PFTaMda9jI7BibFba4S5DwSN3V7rcTy7nu_z4oyIcJ7303PdZcPYWaKqFv-xSS5Pi4EpifltyA5Q4bOMuwrk6PZXf5prPBFVwmuKuTTlnOPPTNHxSfV--zUVfDdnTLphiAc4 Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: d45136a1cdbf4e93b9cf71d33443220f Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:06:15.987903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:06:15.989595 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d45136a1cdbf4e93b9cf71d33443220f", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:06:15.989595 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:06:15.989595 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: d45136a1cdbf4e93b9cf71d33443220f Jul 25 06:06:15.989595 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:06:15.989595 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-AttachVolumeShelveTestJSON-981251187-project Jul 25 06:06:15.989595 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:06:15.989595 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:06:15.989595 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 7f269cd38f734209ba0496cf70469608 Jul 25 06:06:15.989595 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-AttachVolumeShelveTestJSON-981251187-project Jul 25 06:06:15.989595 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:06:15.989595 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. Jul 25 06:06:15.989595 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '348f256d-41e5-47d8-b165-cad6dfcd0be9'} Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:15.990728 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. Jul 25 06:06:15.992556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:15.994675 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ee2d9dbf-df8a-4caf-933a-490f66311386 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Returning 404 to user: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:15.994675 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ee2d9dbf-df8a-4caf-933a-490f66311386 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "DELETE /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 404 len: 111 microversion: 2.20 time: 0.036013 Jul 25 06:06:15.994675 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 551/1077] 10.222.0.17 () {60 vars in 1279 bytes} [Mon Jul 25 06:06:15 2022] DELETE /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 06:06:16.000078 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b6423f1c-44aa-46d3-bb2a-1ac35c0ca444 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:16.003541 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b6423f1c-44aa-46d3-bb2a-1ac35c0ca444 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] [instance: 348f256d-41e5-47d8-b165-cad6dfcd0be9] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:16.007886 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b6423f1c-44aa-46d3-bb2a-1ac35c0ca444 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:16.008343 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b6423f1c-44aa-46d3-bb2a-1ac35c0ca444 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:16.009153 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b6423f1c-44aa-46d3-bb2a-1ac35c0ca444 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:16.009592 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b6423f1c-44aa-46d3-bb2a-1ac35c0ca444 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:16.025570 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-b6423f1c-44aa-46d3-bb2a-1ac35c0ca444 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] HTTP exception thrown: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b6423f1c-44aa-46d3-bb2a-1ac35c0ca444 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Request method failure captured: Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 HTTP/1.1 Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jEa3EM2d9zEpyK_f0kc4EkyDsQlwrxNJdez4UzHU68PFTaMda9jI7BibFba4S5DwSN3V7rcTy7nu_z4oyIcJ7303PdZcPYWaKqFv-xSS5Pi4EpifltyA5Q4bOMuwrk6PZXf5prPBFVwmuKuTTlnOPPTNHxSfV--zUVfDdnTLphiAc4 Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: d45136a1cdbf4e93b9cf71d33443220f Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:06:16.028084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:06:16.029810 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d45136a1cdbf4e93b9cf71d33443220f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d45136a1cdbf4e93b9cf71d33443220f", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:06:16.029810 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:06:16.029810 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: d45136a1cdbf4e93b9cf71d33443220f Jul 25 06:06:16.029810 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-981251187 Jul 25 06:06:16.029810 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-AttachVolumeShelveTestJSON-981251187-project Jul 25 06:06:16.029810 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:06:16.029810 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:06:16.029810 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 7f269cd38f734209ba0496cf70469608 Jul 25 06:06:16.029810 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-AttachVolumeShelveTestJSON-981251187-project Jul 25 06:06:16.029810 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:06:16.029810 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. Jul 25 06:06:16.029810 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '348f256d-41e5-47d8-b165-cad6dfcd0be9'} Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:16.030727 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. Jul 25 06:06:16.032248 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:16.033667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b6423f1c-44aa-46d3-bb2a-1ac35c0ca444 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] Returning 404 to user: Instance 348f256d-41e5-47d8-b165-cad6dfcd0be9 could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:16.033667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b6423f1c-44aa-46d3-bb2a-1ac35c0ca444 tempest-AttachVolumeShelveTestJSON-981251187 tempest-AttachVolumeShelveTestJSON-981251187-project] 10.222.0.17 "GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9" status: 404 len: 111 microversion: 2.20 time: 0.033586 Jul 25 06:06:16.033667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 527/1078] 10.222.0.17 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:15 2022] GET /compute/v2.1/servers/348f256d-41e5-47d8-b165-cad6dfcd0be9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 06:06:22.508068 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-05842728-676f-4da2-97f5-9d84ae272913 tempest-VolumesGetTestJSON-989183927 tempest-VolumesGetTestJSON-989183927-project] Action: 'create', calling method: .version_select at 0x7f9d361c2dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-874726517", "metadata": {"Type": "work"}}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:06:23.170054 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-05842728-676f-4da2-97f5-9d84ae272913 tempest-VolumesGetTestJSON-989183927 tempest-VolumesGetTestJSON-989183927-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.883518 Jul 25 06:06:23.171136 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 552/1079] 10.222.0.17 () {60 vars in 1155 bytes} [Mon Jul 25 06:06:22 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 885 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 06:06:23.182633 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1e048c75-ba1a-498f-9c00-251f4f5760dd tempest-VolumesGetTestJSON-989183927 tempest-VolumesGetTestJSON-989183927-project] Calling method '.version_select at 0x7f9d36a0f310>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:23.241068 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1e048c75-ba1a-498f-9c00-251f4f5760dd tempest-VolumesGetTestJSON-989183927 tempest-VolumesGetTestJSON-989183927-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1079d5a7-6b64-471d-8d7f-c1d6871f8349" status: 200 len: 352 microversion: 2.1 time: 0.063067 Jul 25 06:06:23.241662 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 528/1080] 10.222.0.17 () {58 vars in 1244 bytes} [Mon Jul 25 06:06:23 2022] GET /compute/v2.1/os-volumes/1079d5a7-6b64-471d-8d7f-c1d6871f8349 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:06:24.253430 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-1e20aeed-de80-496e-b675-eefacfa5b798 tempest-VolumesGetTestJSON-989183927 tempest-VolumesGetTestJSON-989183927-project] Calling method '.version_select at 0x7f9d361a5e50>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:24.301594 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-1e20aeed-de80-496e-b675-eefacfa5b798 tempest-VolumesGetTestJSON-989183927 tempest-VolumesGetTestJSON-989183927-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1079d5a7-6b64-471d-8d7f-c1d6871f8349" status: 200 len: 353 microversion: 2.1 time: 0.051740 Jul 25 06:06:24.301893 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 553/1081] 10.222.0.17 () {58 vars in 1244 bytes} [Mon Jul 25 06:06:24 2022] GET /compute/v2.1/os-volumes/1079d5a7-6b64-471d-8d7f-c1d6871f8349 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:06:24.313237 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-677f05eb-86db-4c44-8219-d50b77acddc8 tempest-VolumesGetTestJSON-989183927 tempest-VolumesGetTestJSON-989183927-project] Calling method '.version_select at 0x7f9d36a01670>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:24.362215 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-677f05eb-86db-4c44-8219-d50b77acddc8 tempest-VolumesGetTestJSON-989183927 tempest-VolumesGetTestJSON-989183927-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1079d5a7-6b64-471d-8d7f-c1d6871f8349" status: 200 len: 353 microversion: 2.1 time: 0.049843 Jul 25 06:06:24.362215 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 529/1082] 10.222.0.17 () {58 vars in 1244 bytes} [Mon Jul 25 06:06:24 2022] GET /compute/v2.1/os-volumes/1079d5a7-6b64-471d-8d7f-c1d6871f8349 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:06:24.371903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-072eb322-9386-4d68-9531-6334f313d11b tempest-VolumesGetTestJSON-989183927 tempest-VolumesGetTestJSON-989183927-project] Calling method '.version_select at 0x7f9d361c2790>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:24.559097 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-072eb322-9386-4d68-9531-6334f313d11b tempest-VolumesGetTestJSON-989183927 tempest-VolumesGetTestJSON-989183927-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/1079d5a7-6b64-471d-8d7f-c1d6871f8349" status: 202 len: 0 microversion: 2.1 time: 0.190819 Jul 25 06:06:24.559679 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 554/1083] 10.222.0.17 () {58 vars in 1247 bytes} [Mon Jul 25 06:06:24 2022] DELETE /compute/v2.1/os-volumes/1079d5a7-6b64-471d-8d7f-c1d6871f8349 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:06:24.569105 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b8dec308-deb3-415d-9cc6-3232e8a4ebef tempest-VolumesGetTestJSON-989183927 tempest-VolumesGetTestJSON-989183927-project] Calling method '.version_select at 0x7f9d36bafaf0>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:24.636260 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b8dec308-deb3-415d-9cc6-3232e8a4ebef tempest-VolumesGetTestJSON-989183927 tempest-VolumesGetTestJSON-989183927-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1079d5a7-6b64-471d-8d7f-c1d6871f8349" status: 200 len: 352 microversion: 2.1 time: 0.071255 Jul 25 06:06:24.636984 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 530/1084] 10.222.0.17 () {58 vars in 1244 bytes} [Mon Jul 25 06:06:24 2022] GET /compute/v2.1/os-volumes/1079d5a7-6b64-471d-8d7f-c1d6871f8349 => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:06:25.648898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c645fe47-7402-4bc0-af94-64fb1f35c14e tempest-VolumesGetTestJSON-989183927 tempest-VolumesGetTestJSON-989183927-project] Calling method '.version_select at 0x7f9d36109dc0>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:25.677597 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-c645fe47-7402-4bc0-af94-64fb1f35c14e tempest-VolumesGetTestJSON-989183927 tempest-VolumesGetTestJSON-989183927-project] HTTP exception thrown: Volume 1079d5a7-6b64-471d-8d7f-c1d6871f8349 could not be found. Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c645fe47-7402-4bc0-af94-64fb1f35c14e tempest-VolumesGetTestJSON-989183927 tempest-VolumesGetTestJSON-989183927-project] Request method failure captured: Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/os-volumes/1079d5a7-6b64-471d-8d7f-c1d6871f8349 HTTP/1.1 Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jLeZphIIqUYr3ySfl4OLA73h1ofQ74TE3fGFQ5H7Cqa6jEliADLKL3lODVSE-7omh3ETOxa_2nP-dKos6Yz1QZX-TikQ0haIZJlZgaHyNRXckCRJjTuy-UsWj7W02Yefq2Q6okPhXZsKSBnDysl3Wmrw-74oxfdcN_Dg0ZYBtEh6I8 Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 75e99506e5fc403180a7e1d77334ec05 Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-VolumesGetTestJSON-989183927 Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:06:25.679586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:06:25.681888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/75e99506e5fc403180a7e1d77334ec05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/75e99506e5fc403180a7e1d77334ec05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/75e99506e5fc403180a7e1d77334ec05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_75e99506e5fc403180a7e1d77334ec05", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:06:25.681888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-VolumesGetTestJSON-989183927 Jul 25 06:06:25.681888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 75e99506e5fc403180a7e1d77334ec05 Jul 25 06:06:25.681888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-VolumesGetTestJSON-989183927 Jul 25 06:06:25.681888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-VolumesGetTestJSON-989183927-project Jul 25 06:06:25.681888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:06:25.681888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:06:25.681888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: c1563f0b55994301b27e4017a325350b Jul 25 06:06:25.681888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-VolumesGetTestJSON-989183927-project Jul 25 06:06:25.681888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: Jul 25 06:06:25.681888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Volume 1079d5a7-6b64-471d-8d7f-c1d6871f8349 could not be found. Jul 25 06:06:25.681888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '1079d5a7-6b64-471d-8d7f-c1d6871f8349'} Jul 25 06:06:25.681888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1079d5a7-6b64-471d-8d7f-c1d6871f8349 could not be found. (HTTP 404) (Request-ID: req-3d262e2a-e6e5-4e3c-9254-6dc69ebcd477) Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:25.682935 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 06:06:25.684340 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1079d5a7-6b64-471d-8d7f-c1d6871f8349 could not be found. Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 06:06:25.685668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:25.701512 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1079d5a7-6b64-471d-8d7f-c1d6871f8349 could not be found. Jul 25 06:06:25.701512 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:25.701512 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:25.701512 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:25.701512 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:25.701512 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:25.701512 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:25.701512 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:25.701512 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:25.701512 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1079d5a7-6b64-471d-8d7f-c1d6871f8349 could not be found. Jul 25 06:06:25.701512 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:25.701512 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c645fe47-7402-4bc0-af94-64fb1f35c14e tempest-VolumesGetTestJSON-989183927 tempest-VolumesGetTestJSON-989183927-project] Returning 404 to user: Volume 1079d5a7-6b64-471d-8d7f-c1d6871f8349 could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:25.701512 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c645fe47-7402-4bc0-af94-64fb1f35c14e tempest-VolumesGetTestJSON-989183927 tempest-VolumesGetTestJSON-989183927-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1079d5a7-6b64-471d-8d7f-c1d6871f8349" status: 404 len: 109 microversion: 2.1 time: 0.043952 Jul 25 06:06:25.701512 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 555/1085] 10.222.0.17 () {58 vars in 1244 bytes} [Mon Jul 25 06:06:25 2022] GET /compute/v2.1/os-volumes/1079d5a7-6b64-471d-8d7f-c1d6871f8349 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:06:27.827008 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:06:27.828007 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=30 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:06:27.946895 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b0890e1f-17dd-4c0e-9b6d-90922877a55d tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Action: 'create', calling method: .version_select at 0x7f9d36a51b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-291842304", "metadata": {"Type": "work"}}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b0890e1f-17dd-4c0e-9b6d-90922877a55d tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Request method failure captured: Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 121 Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jLjGpJKgEWu92JM1JZEy7tkkBNApA2J_Bf8lxDc-idea31Qdt2GYmPzjX7sxjxvNtWaYWCClExPLa5oCLN0rx7VOWTuSb27ZD31YLtiGgTcvQMUWeoHz6V7DZIA04kOipeFBW2Mf_663CryBpKBVdoJA40Q5DMfyr0DKbD2q29r2U4 Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: 909441cb99d247109c47fc531020f38c Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:06:27.973862 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:06:27.975356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/909441cb99d247109c47fc531020f38c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/909441cb99d247109c47fc531020f38c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/909441cb99d247109c47fc531020f38c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_909441cb99d247109c47fc531020f38c", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:06:27.975356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:27.975356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: 909441cb99d247109c47fc531020f38c Jul 25 06:06:27.975356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:27.975356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-VolumesNegativeTest-1014892080-project Jul 25 06:06:27.975356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:06:27.975356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:06:27.975356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 199efed2957d4854af7adc758e60196d Jul 25 06:06:27.975356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-VolumesNegativeTest-1014892080-project Jul 25 06:06:27.975356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Jul 25 06:06:27.975356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-291842304", "metadata": {"Type": "work"}}} Jul 25 06:06:27.975356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: Jul 25 06:06:27.975356 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-291842304', 'metadata': {'Type': 'work'}}}} Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise error Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi '#$%' Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:27.976372 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 06:06:27.982853 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 06:06:27.984212 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 06:06:27.984212 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:27.984212 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b0890e1f-17dd-4c0e-9b6d-90922877a55d tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:27.984212 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b0890e1f-17dd-4c0e-9b6d-90922877a55d tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.149662 Jul 25 06:06:27.984212 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 531/1086] 10.222.0.17 () {60 vars in 1155 bytes} [Mon Jul 25 06:06:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 06:06:27.984584 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:06:27.984584 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:06:27.989116 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-70d3b3c6-9533-4e8d-93da-cc4d5e6911a4 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Action: 'create', calling method: .version_select at 0x7f9d361c2dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1041774619", "metadata": {"Type": "work"}}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-70d3b3c6-9533-4e8d-93da-cc4d5e6911a4 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Request method failure captured: Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 120 Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jLjGpJKgEWu92JM1JZEy7tkkBNApA2J_Bf8lxDc-idea31Qdt2GYmPzjX7sxjxvNtWaYWCClExPLa5oCLN0rx7VOWTuSb27ZD31YLtiGgTcvQMUWeoHz6V7DZIA04kOipeFBW2Mf_663CryBpKBVdoJA40Q5DMfyr0DKbD2q29r2U4 Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 909441cb99d247109c47fc531020f38c Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:06:27.992407 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:06:27.993816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/909441cb99d247109c47fc531020f38c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/909441cb99d247109c47fc531020f38c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/909441cb99d247109c47fc531020f38c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_909441cb99d247109c47fc531020f38c", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:06:27.993816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:27.993816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 909441cb99d247109c47fc531020f38c Jul 25 06:06:27.993816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:27.993816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-VolumesNegativeTest-1014892080-project Jul 25 06:06:27.993816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:06:27.993816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:06:27.993816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 199efed2957d4854af7adc758e60196d Jul 25 06:06:27.993816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-VolumesNegativeTest-1014892080-project Jul 25 06:06:27.993816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Jul 25 06:06:27.993816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1041774619", "metadata": {"Type": "work"}}} Jul 25 06:06:27.993816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: Jul 25 06:06:27.993816 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1041774619', 'metadata': {'Type': 'work'}}}} Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise error Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi '0' Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:27.994688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 06:06:27.996001 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 06:06:27.997241 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 06:06:27.997241 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:27.997241 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-70d3b3c6-9533-4e8d-93da-cc4d5e6911a4 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:27.997241 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-70d3b3c6-9533-4e8d-93da-cc4d5e6911a4 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011698 Jul 25 06:06:27.997241 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 556/1087] 10.222.0.17 () {60 vars in 1155 bytes} [Mon Jul 25 06:06:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 06:06:28.003839 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0512a0f8-862c-4075-a994-a211effd3be4 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Action: 'create', calling method: .version_select at 0x7f9d361d7ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-390011246", "metadata": {"Type": "work"}}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0512a0f8-862c-4075-a994-a211effd3be4 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Request method failure captured: Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 118 Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jLjGpJKgEWu92JM1JZEy7tkkBNApA2J_Bf8lxDc-idea31Qdt2GYmPzjX7sxjxvNtWaYWCClExPLa5oCLN0rx7VOWTuSb27ZD31YLtiGgTcvQMUWeoHz6V7DZIA04kOipeFBW2Mf_663CryBpKBVdoJA40Q5DMfyr0DKbD2q29r2U4 Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: 909441cb99d247109c47fc531020f38c Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:06:28.008010 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:06:28.015726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/909441cb99d247109c47fc531020f38c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/909441cb99d247109c47fc531020f38c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/909441cb99d247109c47fc531020f38c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_909441cb99d247109c47fc531020f38c", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:06:28.015726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:28.015726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: 909441cb99d247109c47fc531020f38c Jul 25 06:06:28.015726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:28.015726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-VolumesNegativeTest-1014892080-project Jul 25 06:06:28.015726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:06:28.015726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:06:28.015726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 199efed2957d4854af7adc758e60196d Jul 25 06:06:28.015726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-VolumesNegativeTest-1014892080-project Jul 25 06:06:28.015726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Jul 25 06:06:28.015726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-390011246", "metadata": {"Type": "work"}}} Jul 25 06:06:28.015726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: Jul 25 06:06:28.015726 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-390011246', 'metadata': {'Type': 'work'}}}} Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise error Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi '' Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:28.017276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 06:06:28.019990 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 06:06:28.021651 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 06:06:28.021651 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.021651 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0512a0f8-862c-4075-a994-a211effd3be4 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:28.021651 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0512a0f8-862c-4075-a994-a211effd3be4 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009505 Jul 25 06:06:28.021651 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 532/1088] 10.222.0.17 () {60 vars in 1155 bytes} [Mon Jul 25 06:06:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 06:06:28.027971 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-fa9007e6-9768-4786-8cc1-2f61be58a848 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Calling method '.version_select at 0x7f9d361a5700>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:28.056790 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-fa9007e6-9768-4786-8cc1-2f61be58a848 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] HTTP exception thrown: Volume tempest-invalid-2036875418 could not be found. Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-fa9007e6-9768-4786-8cc1-2f61be58a848 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Request method failure captured: Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2036875418 HTTP/1.1 Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jLjGpJKgEWu92JM1JZEy7tkkBNApA2J_Bf8lxDc-idea31Qdt2GYmPzjX7sxjxvNtWaYWCClExPLa5oCLN0rx7VOWTuSb27ZD31YLtiGgTcvQMUWeoHz6V7DZIA04kOipeFBW2Mf_663CryBpKBVdoJA40Q5DMfyr0DKbD2q29r2U4 Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 909441cb99d247109c47fc531020f38c Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:06:28.059489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:06:28.060847 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/909441cb99d247109c47fc531020f38c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/909441cb99d247109c47fc531020f38c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/909441cb99d247109c47fc531020f38c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_909441cb99d247109c47fc531020f38c", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:06:28.060847 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:28.060847 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 909441cb99d247109c47fc531020f38c Jul 25 06:06:28.060847 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:28.060847 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-VolumesNegativeTest-1014892080-project Jul 25 06:06:28.060847 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:06:28.060847 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:06:28.060847 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 199efed2957d4854af7adc758e60196d Jul 25 06:06:28.060847 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-VolumesNegativeTest-1014892080-project Jul 25 06:06:28.060847 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: Jul 25 06:06:28.060847 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Volume tempest-invalid-2036875418 could not be found. Jul 25 06:06:28.060847 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': 'tempest-invalid-2036875418'} Jul 25 06:06:28.060847 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2036875418 could not be found. (HTTP 404) (Request-ID: req-c40fa9d1-5e5f-4583-9a7b-0e57e9bb8e3b) Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:28.061990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 06:06:28.063724 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2036875418 could not be found. Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:28.064896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2036875418 could not be found. Jul 25 06:06:28.068066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.068066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:28.068066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.068066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:28.068066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:28.068066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:28.068066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:28.068066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:28.068066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2036875418 could not be found. Jul 25 06:06:28.068066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.068066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-fa9007e6-9768-4786-8cc1-2f61be58a848 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Returning 404 to user: Volume tempest-invalid-2036875418 could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:28.068066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-fa9007e6-9768-4786-8cc1-2f61be58a848 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2036875418" status: 404 len: 99 microversion: 2.1 time: 0.037624 Jul 25 06:06:28.068066 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 557/1089] 10.222.0.17 () {58 vars in 1217 bytes} [Mon Jul 25 06:06:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2036875418 => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 06:06:28.070910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-24e09aa3-57ca-49ee-b8eb-1244f928c2b9 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004015 Jul 25 06:06:28.071696 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 533/1090] 10.222.0.17 () {58 vars in 1139 bytes} [Mon Jul 25 06:06:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 06:06:28.085413 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-402b2db5-0a12-41a0-a615-82718bfe4416 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003784 Jul 25 06:06:28.085920 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 558/1091] 10.222.0.17 () {58 vars in 1136 bytes} [Mon Jul 25 06:06:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 06:06:28.095948 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e367942c-1b0f-4181-9cb5-958c7cff37f5 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Calling method '.version_select at 0x7f9d36baf700>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:28.125150 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-e367942c-1b0f-4181-9cb5-958c7cff37f5 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] HTTP exception thrown: Volume 8c3b5d3a-f669-4aed-a893-5ce4a7ac696f could not be found. Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e367942c-1b0f-4181-9cb5-958c7cff37f5 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Request method failure captured: Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: DELETE /compute/v2.1/os-volumes/8c3b5d3a-f669-4aed-a893-5ce4a7ac696f HTTP/1.1 Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jLjGpJKgEWu92JM1JZEy7tkkBNApA2J_Bf8lxDc-idea31Qdt2GYmPzjX7sxjxvNtWaYWCClExPLa5oCLN0rx7VOWTuSb27ZD31YLtiGgTcvQMUWeoHz6V7DZIA04kOipeFBW2Mf_663CryBpKBVdoJA40Q5DMfyr0DKbD2q29r2U4 Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: 909441cb99d247109c47fc531020f38c Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:06:28.128426 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:06:28.129800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/909441cb99d247109c47fc531020f38c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/909441cb99d247109c47fc531020f38c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/909441cb99d247109c47fc531020f38c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_909441cb99d247109c47fc531020f38c", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:06:28.129800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:28.129800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: 909441cb99d247109c47fc531020f38c Jul 25 06:06:28.129800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:28.129800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-VolumesNegativeTest-1014892080-project Jul 25 06:06:28.129800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:06:28.129800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:06:28.129800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 199efed2957d4854af7adc758e60196d Jul 25 06:06:28.129800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-VolumesNegativeTest-1014892080-project Jul 25 06:06:28.129800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: Jul 25 06:06:28.129800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Volume 8c3b5d3a-f669-4aed-a893-5ce4a7ac696f could not be found. Jul 25 06:06:28.129800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '8c3b5d3a-f669-4aed-a893-5ce4a7ac696f'} Jul 25 06:06:28.129800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c3b5d3a-f669-4aed-a893-5ce4a7ac696f could not be found. (HTTP 404) (Request-ID: req-867d25f4-4368-4251-a8b1-1b1967e85181) Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:28.130881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 06:06:28.132118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c3b5d3a-f669-4aed-a893-5ce4a7ac696f could not be found. Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 06:06:28.133279 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:28.134499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c3b5d3a-f669-4aed-a893-5ce4a7ac696f could not be found. Jul 25 06:06:28.134499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.134499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:28.134499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.134499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:28.134499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:28.134499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:28.134499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:28.134499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:28.134499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c3b5d3a-f669-4aed-a893-5ce4a7ac696f could not be found. Jul 25 06:06:28.134499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.134499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e367942c-1b0f-4181-9cb5-958c7cff37f5 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Returning 404 to user: Volume 8c3b5d3a-f669-4aed-a893-5ce4a7ac696f could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:28.134499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e367942c-1b0f-4181-9cb5-958c7cff37f5 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/8c3b5d3a-f669-4aed-a893-5ce4a7ac696f" status: 404 len: 109 microversion: 2.1 time: 0.038568 Jul 25 06:06:28.134499 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 534/1092] 10.222.0.17 () {58 vars in 1247 bytes} [Mon Jul 25 06:06:28 2022] DELETE /compute/v2.1/os-volumes/8c3b5d3a-f669-4aed-a893-5ce4a7ac696f => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:06:28.142318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-342b48ba-da16-4884-a18e-e0f5e3f95b20 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Calling method '.version_select at 0x7f9d361c2280>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:28.172202 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-342b48ba-da16-4884-a18e-e0f5e3f95b20 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] HTTP exception thrown: Volume e6a5c256-c6a4-4c5a-8006-dd71a11db5bf could not be found. Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-342b48ba-da16-4884-a18e-e0f5e3f95b20 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Request method failure captured: Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/os-volumes/e6a5c256-c6a4-4c5a-8006-dd71a11db5bf HTTP/1.1 Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jLjGpJKgEWu92JM1JZEy7tkkBNApA2J_Bf8lxDc-idea31Qdt2GYmPzjX7sxjxvNtWaYWCClExPLa5oCLN0rx7VOWTuSb27ZD31YLtiGgTcvQMUWeoHz6V7DZIA04kOipeFBW2Mf_663CryBpKBVdoJA40Q5DMfyr0DKbD2q29r2U4 Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 909441cb99d247109c47fc531020f38c Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:06:28.174209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:06:28.175888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/909441cb99d247109c47fc531020f38c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/909441cb99d247109c47fc531020f38c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/909441cb99d247109c47fc531020f38c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_909441cb99d247109c47fc531020f38c", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:06:28.175888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:28.175888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 909441cb99d247109c47fc531020f38c Jul 25 06:06:28.175888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-VolumesNegativeTest-1014892080 Jul 25 06:06:28.175888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-VolumesNegativeTest-1014892080-project Jul 25 06:06:28.175888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:06:28.175888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:06:28.175888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 199efed2957d4854af7adc758e60196d Jul 25 06:06:28.175888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-VolumesNegativeTest-1014892080-project Jul 25 06:06:28.175888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: Jul 25 06:06:28.175888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Volume e6a5c256-c6a4-4c5a-8006-dd71a11db5bf could not be found. Jul 25 06:06:28.175888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': 'e6a5c256-c6a4-4c5a-8006-dd71a11db5bf'} Jul 25 06:06:28.175888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e6a5c256-c6a4-4c5a-8006-dd71a11db5bf could not be found. (HTTP 404) (Request-ID: req-21becc47-eb29-4fa1-8f3a-e7034cac2925) Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:28.176865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 06:06:28.178339 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e6a5c256-c6a4-4c5a-8006-dd71a11db5bf could not be found. Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 06:06:28.179797 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:28.181243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e6a5c256-c6a4-4c5a-8006-dd71a11db5bf could not be found. Jul 25 06:06:28.181243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.181243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:28.181243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.181243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:28.181243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:28.181243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:28.181243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:28.181243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:28.181243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e6a5c256-c6a4-4c5a-8006-dd71a11db5bf could not be found. Jul 25 06:06:28.181243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:06:28.181243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-342b48ba-da16-4884-a18e-e0f5e3f95b20 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] Returning 404 to user: Volume e6a5c256-c6a4-4c5a-8006-dd71a11db5bf could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:28.181243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-342b48ba-da16-4884-a18e-e0f5e3f95b20 tempest-VolumesNegativeTest-1014892080 tempest-VolumesNegativeTest-1014892080-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e6a5c256-c6a4-4c5a-8006-dd71a11db5bf" status: 404 len: 109 microversion: 2.1 time: 0.037203 Jul 25 06:06:28.181243 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 559/1093] 10.222.0.17 () {58 vars in 1244 bytes} [Mon Jul 25 06:06:28 2022] GET /compute/v2.1/os-volumes/e6a5c256-c6a4-4c5a-8006-dd71a11db5bf => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:06:56.051143 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e6eaae21-fc46-4e43-93c8-706a11d020cb tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Action: 'create', calling method: .version_select at 0x7f9d361d78b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1104445890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqZQAlOD3DbvimAeJRyQ6LpMfUkpjJyLYjDro/eGvVPQrPXR5xgfy8vMlLf6A471yaS1wtqKON4KM0nEgehhsBHR9pz0OWhxTkvYLA8GllgrB6ji70zveBhz/aZtJCyAw=="}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:06:56.069287 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-e6eaae21-fc46-4e43-93c8-706a11d020cb tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Getting quotas for project a39f82493df2479395de88147e2f8292. Resources: {'key_pairs'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:06:56.072734 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-e6eaae21-fc46-4e43-93c8-706a11d020cb tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Getting quotas for user a01a4b9868714295a1000e0a5a81143b and project a39f82493df2479395de88147e2f8292. Resources: {'key_pairs'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:06:56.165652 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e6eaae21-fc46-4e43-93c8-706a11d020cb tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.118181 Jul 25 06:06:56.166253 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 535/1094] 10.222.0.17 () {60 vars in 1158 bytes} [Mon Jul 25 06:06:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:06:56.274711 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c1324f57-e043-433a-b90c-e7b4bcca45b6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2002559379", "imageRef": "d99ac403-6610-4113-8d27-2814d6a5aab3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1104445890", "networks": [{"uuid": "e9ad1772-2cfd-4470-a813-022b391af3f7"}]}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:06:56.328471 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.network.neutron [None req-c1324f57-e043-433a-b90c-e7b4bcca45b6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] validate_networks() for [('e9ad1772-2cfd-4470-a813-022b391af3f7', None, None, None, None, None)] {{(pid=130163) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:06:56.721479 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-c1324f57-e043-433a-b90c-e7b4bcca45b6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Flavor limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:06:56.721479 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-c1324f57-e043-433a-b90c-e7b4bcca45b6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Image limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:06:56.721479 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-c1324f57-e043-433a-b90c-e7b4bcca45b6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Flavor pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:06:56.721479 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-c1324f57-e043-433a-b90c-e7b4bcca45b6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Image pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:06:56.721976 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-c1324f57-e043-433a-b90c-e7b4bcca45b6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:06:56.733691 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c1324f57-e043-433a-b90c-e7b4bcca45b6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:56.734125 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c1324f57-e043-433a-b90c-e7b4bcca45b6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:56.735006 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c1324f57-e043-433a-b90c-e7b4bcca45b6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:56.735404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c1324f57-e043-433a-b90c-e7b4bcca45b6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:56.757503 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-c1324f57-e043-433a-b90c-e7b4bcca45b6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Getting quotas for project a39f82493df2479395de88147e2f8292. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:06:56.766063 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-c1324f57-e043-433a-b90c-e7b4bcca45b6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Getting quotas for user a01a4b9868714295a1000e0a5a81143b and project a39f82493df2479395de88147e2f8292. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:06:56.777667 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c1324f57-e043-433a-b90c-e7b4bcca45b6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Going to run 1 instances... {{(pid=130163) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:06:56.779942 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c1324f57-e043-433a-b90c-e7b4bcca45b6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d99ac403-6610-4113-8d27-2814d6a5aab3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:06:56.921716 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c1324f57-e043-433a-b90c-e7b4bcca45b6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653317 Jul 25 06:06:56.922608 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 560/1095] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 06:06:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:06:56.937758 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d659ee59-5c54-454a-a8c0-c2ea1212c2aa tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:56.939322 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d659ee59-5c54-454a-a8c0-c2ea1212c2aa tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:57.001516 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d659ee59-5c54-454a-a8c0-c2ea1212c2aa tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:57.008217 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d659ee59-5c54-454a-a8c0-c2ea1212c2aa tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1259 microversion: 2.1 time: 0.079069 Jul 25 06:06:57.008781 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 536/1096] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:56 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1259 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:58.026602 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3ea7f811-a5a6-4156-993e-0ca4c2b25be2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:58.027990 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-3ea7f811-a5a6-4156-993e-0ca4c2b25be2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:58.082501 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3ea7f811-a5a6-4156-993e-0ca4c2b25be2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:58.089324 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-3ea7f811-a5a6-4156-993e-0ca4c2b25be2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1259 microversion: 2.1 time: 0.067691 Jul 25 06:06:58.089898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 561/1097] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:58 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:06:59.106453 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9d38320b-1b23-46b0-a844-7282d37e7e9b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:59.107095 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-9d38320b-1b23-46b0-a844-7282d37e7e9b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:59.113739 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9d38320b-1b23-46b0-a844-7282d37e7e9b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:59.114126 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9d38320b-1b23-46b0-a844-7282d37e7e9b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:59.114928 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9d38320b-1b23-46b0-a844-7282d37e7e9b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:59.115361 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9d38320b-1b23-46b0-a844-7282d37e7e9b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:59.190170 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-9d38320b-1b23-46b0-a844-7282d37e7e9b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:59.198956 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-9d38320b-1b23-46b0-a844-7282d37e7e9b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1311 microversion: 2.1 time: 0.096884 Jul 25 06:06:59.199529 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 537/1098] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:59 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:00.216945 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-4a98dccd-cbc1-4082-8001-293efae53c7f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:00.217766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-4a98dccd-cbc1-4082-8001-293efae53c7f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:00.225875 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4a98dccd-cbc1-4082-8001-293efae53c7f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:00.226356 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4a98dccd-cbc1-4082-8001-293efae53c7f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:00.227219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4a98dccd-cbc1-4082-8001-293efae53c7f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:00.227666 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-4a98dccd-cbc1-4082-8001-293efae53c7f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:00.497732 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-4a98dccd-cbc1-4082-8001-293efae53c7f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:00.508023 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-4a98dccd-cbc1-4082-8001-293efae53c7f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1359 microversion: 2.1 time: 0.295525 Jul 25 06:07:00.508821 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 562/1099] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:00 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1359 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:07:01.529896 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d65e02c2-3ff2-45f2-bd8b-73caf2eb4498 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:01.530866 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d65e02c2-3ff2-45f2-bd8b-73caf2eb4498 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:01.539921 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d65e02c2-3ff2-45f2-bd8b-73caf2eb4498 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:01.540748 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d65e02c2-3ff2-45f2-bd8b-73caf2eb4498 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:01.542454 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d65e02c2-3ff2-45f2-bd8b-73caf2eb4498 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:01.543268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d65e02c2-3ff2-45f2-bd8b-73caf2eb4498 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:01.647063 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-300a80af-9ac4-4551-9fb5-ae95da74a669 req-501c5047-d619-42e7-8a85-09f000b2891f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b8c81f-8362-4af8-97ce-73dab9c68cc2", "tag": "d4f48ee1-da5f-427a-a821-05c06871ba9f"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:07:01.674702 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-300a80af-9ac4-4551-9fb5-ae95da74a669 req-501c5047-d619-42e7-8a85-09f000b2891f service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:01.675499 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-300a80af-9ac4-4551-9fb5-ae95da74a669 req-501c5047-d619-42e7-8a85-09f000b2891f service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:01.694501 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-300a80af-9ac4-4551-9fb5-ae95da74a669 req-501c5047-d619-42e7-8a85-09f000b2891f service nova] Creating event network-changed:d4f48ee1-da5f-427a-a821-05c06871ba9f for instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 on hv-cinder-85083 Jul 25 06:07:01.700848 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-300a80af-9ac4-4551-9fb5-ae95da74a669 req-501c5047-d619-42e7-8a85-09f000b2891f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057380 Jul 25 06:07:01.702004 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 563/1100] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:07:02.023799 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d65e02c2-3ff2-45f2-bd8b-73caf2eb4498 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:02.041002 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d65e02c2-3ff2-45f2-bd8b-73caf2eb4498 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1359 microversion: 2.1 time: 0.515798 Jul 25 06:07:02.054842 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 538/1101] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:01 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1359 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:07:03.061047 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-31701153-748f-46bf-903e-19a4da8e8833 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:03.062464 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-31701153-748f-46bf-903e-19a4da8e8833 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:03.070039 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-31701153-748f-46bf-903e-19a4da8e8833 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:03.070638 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-31701153-748f-46bf-903e-19a4da8e8833 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:03.071515 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-31701153-748f-46bf-903e-19a4da8e8833 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:03.072047 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-31701153-748f-46bf-903e-19a4da8e8833 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:03.247691 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-31701153-748f-46bf-903e-19a4da8e8833 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:03.255840 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-31701153-748f-46bf-903e-19a4da8e8833 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1359 microversion: 2.1 time: 0.200594 Jul 25 06:07:03.266553 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 564/1102] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:03 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:04.273411 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e96e5664-e22c-4b24-90f4-374008bac12e tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:04.274163 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e96e5664-e22c-4b24-90f4-374008bac12e tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:04.281003 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e96e5664-e22c-4b24-90f4-374008bac12e tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:04.281545 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e96e5664-e22c-4b24-90f4-374008bac12e tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:04.282389 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e96e5664-e22c-4b24-90f4-374008bac12e tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:04.282908 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e96e5664-e22c-4b24-90f4-374008bac12e tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:04.538965 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e96e5664-e22c-4b24-90f4-374008bac12e tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:04.547958 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e96e5664-e22c-4b24-90f4-374008bac12e tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1359 microversion: 2.1 time: 0.278414 Jul 25 06:07:04.548540 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 539/1103] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:04 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1359 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:04.550443 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8a99a9eb-ffd9-4e0d-9caf-ae6be59abf15 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:04.550994 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8a99a9eb-ffd9-4e0d-9caf-ae6be59abf15 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:04.558106 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8a99a9eb-ffd9-4e0d-9caf-ae6be59abf15 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:04.558833 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8a99a9eb-ffd9-4e0d-9caf-ae6be59abf15 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:04.559796 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8a99a9eb-ffd9-4e0d-9caf-ae6be59abf15 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:04.560414 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8a99a9eb-ffd9-4e0d-9caf-ae6be59abf15 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:04.563109 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-a9a8aca0-525b-4539-93fb-4fe5a31adc02 req-a9dc1fbe-034e-4a86-83bd-7f2c05e09e0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1007f9b0-08e2-4d72-91e9-586792d0695b", "tag": "3dfa9b78-4afb-4b3a-b13e-7a68f5d8ecc8"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:07:04.589422 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8a99a9eb-ffd9-4e0d-9caf-ae6be59abf15 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Going to try to terminate instance {{(pid=130163) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:07:04.593342 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-a9a8aca0-525b-4539-93fb-4fe5a31adc02 req-a9dc1fbe-034e-4a86-83bd-7f2c05e09e0a service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:04.596591 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-a9a8aca0-525b-4539-93fb-4fe5a31adc02 req-a9dc1fbe-034e-4a86-83bd-7f2c05e09e0a service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:04.637008 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-a9a8aca0-525b-4539-93fb-4fe5a31adc02 req-a9dc1fbe-034e-4a86-83bd-7f2c05e09e0a service nova] Creating event network-changed:3dfa9b78-4afb-4b3a-b13e-7a68f5d8ecc8 for instance 1007f9b0-08e2-4d72-91e9-586792d0695b on hv-cinder-85083 Jul 25 06:07:04.643113 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-a9a8aca0-525b-4539-93fb-4fe5a31adc02 req-a9dc1fbe-034e-4a86-83bd-7f2c05e09e0a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088318 Jul 25 06:07:04.647808 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 540/1104] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:07:04.976117 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8a99a9eb-ffd9-4e0d-9caf-ae6be59abf15 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 204 len: 0 microversion: 2.1 time: 0.431933 Jul 25 06:07:04.981217 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 565/1105] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:07:04 2022] DELETE /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:07:04.991434 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-26b4680a-ef1c-4086-8dd7-99c68d9df6ef tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:04.993743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-26b4680a-ef1c-4086-8dd7-99c68d9df6ef tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:05.002623 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-26b4680a-ef1c-4086-8dd7-99c68d9df6ef tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:05.005489 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-26b4680a-ef1c-4086-8dd7-99c68d9df6ef tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:05.005489 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-26b4680a-ef1c-4086-8dd7-99c68d9df6ef tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:05.005489 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-26b4680a-ef1c-4086-8dd7-99c68d9df6ef tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:05.189475 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-26b4680a-ef1c-4086-8dd7-99c68d9df6ef tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:05.196836 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-26b4680a-ef1c-4086-8dd7-99c68d9df6ef tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.213993 Jul 25 06:07:05.200792 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 541/1106] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:04 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:07:05.608074 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6ba6e4f3-a9ac-4a5c-932c-1ea710913616 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:05.608074 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6ba6e4f3-a9ac-4a5c-932c-1ea710913616 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:05.608074 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6ba6e4f3-a9ac-4a5c-932c-1ea710913616 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:05.608074 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6ba6e4f3-a9ac-4a5c-932c-1ea710913616 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:05.609343 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6ba6e4f3-a9ac-4a5c-932c-1ea710913616 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:05.609343 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-6ba6e4f3-a9ac-4a5c-932c-1ea710913616 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:06.062138 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6ba6e4f3-a9ac-4a5c-932c-1ea710913616 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:06.070166 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6ba6e4f3-a9ac-4a5c-932c-1ea710913616 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1359 microversion: 2.1 time: 0.508622 Jul 25 06:07:06.070808 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 566/1107] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:05 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1359 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:07:06.214705 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ffdf1bdb-e911-46e5-8814-82e246ddc4ab tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:06.215359 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ffdf1bdb-e911-46e5-8814-82e246ddc4ab tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:06.222037 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ffdf1bdb-e911-46e5-8814-82e246ddc4ab tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:06.222508 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ffdf1bdb-e911-46e5-8814-82e246ddc4ab tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:06.223287 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ffdf1bdb-e911-46e5-8814-82e246ddc4ab tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:06.223729 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ffdf1bdb-e911-46e5-8814-82e246ddc4ab tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:06.370151 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ffdf1bdb-e911-46e5-8814-82e246ddc4ab tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:06.377957 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ffdf1bdb-e911-46e5-8814-82e246ddc4ab tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.167127 Jul 25 06:07:06.379858 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 542/1108] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:06 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:07.088883 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b8ba23f4-84e4-4944-8b81-038fbdf0b9e0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:07.089494 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b8ba23f4-84e4-4944-8b81-038fbdf0b9e0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:07.092222 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=2 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:07.098049 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b8ba23f4-84e4-4944-8b81-038fbdf0b9e0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:07.105078 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b8ba23f4-84e4-4944-8b81-038fbdf0b9e0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:07.105078 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b8ba23f4-84e4-4944-8b81-038fbdf0b9e0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:07.105078 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b8ba23f4-84e4-4944-8b81-038fbdf0b9e0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:07.251058 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b8ba23f4-84e4-4944-8b81-038fbdf0b9e0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:07.258592 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b8ba23f4-84e4-4944-8b81-038fbdf0b9e0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1359 microversion: 2.1 time: 0.173714 Jul 25 06:07:07.259465 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 567/1109] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:07 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:07.396659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-42ad8d96-a569-4ee2-ace1-c6ff830e5b88 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:07.397783 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-42ad8d96-a569-4ee2-ace1-c6ff830e5b88 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:07.400082 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=6 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:07.406213 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-42ad8d96-a569-4ee2-ace1-c6ff830e5b88 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:07.414122 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-42ad8d96-a569-4ee2-ace1-c6ff830e5b88 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:07.414122 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-42ad8d96-a569-4ee2-ace1-c6ff830e5b88 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:07.414122 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-42ad8d96-a569-4ee2-ace1-c6ff830e5b88 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:07.563207 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-42ad8d96-a569-4ee2-ace1-c6ff830e5b88 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:07.573062 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-42ad8d96-a569-4ee2-ace1-c6ff830e5b88 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.180660 Jul 25 06:07:07.575225 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 543/1110] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:07 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:08.277125 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d2cffddd-ec23-44e9-ad43-2209e3282dd6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:08.277750 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d2cffddd-ec23-44e9-ad43-2209e3282dd6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:08.279584 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=8 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:08.284435 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d2cffddd-ec23-44e9-ad43-2209e3282dd6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:08.284881 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d2cffddd-ec23-44e9-ad43-2209e3282dd6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:08.285657 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d2cffddd-ec23-44e9-ad43-2209e3282dd6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:08.286083 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d2cffddd-ec23-44e9-ad43-2209e3282dd6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:08.421525 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d2cffddd-ec23-44e9-ad43-2209e3282dd6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:08.429021 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d2cffddd-ec23-44e9-ad43-2209e3282dd6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1359 microversion: 2.1 time: 0.155890 Jul 25 06:07:08.429579 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 568/1111] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:08 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:08.590566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-fb1d8ed5-6790-4b11-9294-446a89831205 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:08.591180 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-fb1d8ed5-6790-4b11-9294-446a89831205 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:08.597538 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fb1d8ed5-6790-4b11-9294-446a89831205 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:08.597982 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fb1d8ed5-6790-4b11-9294-446a89831205 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:08.598769 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fb1d8ed5-6790-4b11-9294-446a89831205 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:08.599228 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fb1d8ed5-6790-4b11-9294-446a89831205 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:08.728116 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-fb1d8ed5-6790-4b11-9294-446a89831205 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:08.736172 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-fb1d8ed5-6790-4b11-9294-446a89831205 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.150022 Jul 25 06:07:08.736732 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 544/1112] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:08 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:09.445418 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-63e57eae-071c-48e6-90e5-8711cc019a00 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:09.446027 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-63e57eae-071c-48e6-90e5-8711cc019a00 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:09.453733 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63e57eae-071c-48e6-90e5-8711cc019a00 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:09.453856 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63e57eae-071c-48e6-90e5-8711cc019a00 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:09.454532 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63e57eae-071c-48e6-90e5-8711cc019a00 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:09.454967 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-63e57eae-071c-48e6-90e5-8711cc019a00 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:09.582035 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-63e57eae-071c-48e6-90e5-8711cc019a00 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:09.589918 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-63e57eae-071c-48e6-90e5-8711cc019a00 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1359 microversion: 2.1 time: 0.148281 Jul 25 06:07:09.590532 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 569/1113] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:09 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:09.753501 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-086638a2-b864-4d26-9505-aefd0391028a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:09.754026 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-086638a2-b864-4d26-9505-aefd0391028a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:09.761401 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-086638a2-b864-4d26-9505-aefd0391028a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:09.761837 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-086638a2-b864-4d26-9505-aefd0391028a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:09.762616 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-086638a2-b864-4d26-9505-aefd0391028a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:09.763048 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-086638a2-b864-4d26-9505-aefd0391028a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:09.897044 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-086638a2-b864-4d26-9505-aefd0391028a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:09.904637 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-086638a2-b864-4d26-9505-aefd0391028a tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.155297 Jul 25 06:07:09.905192 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 545/1114] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:09 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:10.606871 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3b46c4aa-c59b-449f-8c6b-ccadb46b68e0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:10.608183 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-3b46c4aa-c59b-449f-8c6b-ccadb46b68e0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:10.614853 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3b46c4aa-c59b-449f-8c6b-ccadb46b68e0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:10.615300 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3b46c4aa-c59b-449f-8c6b-ccadb46b68e0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:10.616064 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3b46c4aa-c59b-449f-8c6b-ccadb46b68e0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:10.616492 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3b46c4aa-c59b-449f-8c6b-ccadb46b68e0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:10.857389 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3b46c4aa-c59b-449f-8c6b-ccadb46b68e0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:10.865559 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-3b46c4aa-c59b-449f-8c6b-ccadb46b68e0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1359 microversion: 2.1 time: 0.262529 Jul 25 06:07:10.876263 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 570/1115] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:10 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:10.923565 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2d75eb11-046b-4365-9c28-0b2ae60c1386 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:10.924194 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2d75eb11-046b-4365-9c28-0b2ae60c1386 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:10.931475 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2d75eb11-046b-4365-9c28-0b2ae60c1386 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:10.933383 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2d75eb11-046b-4365-9c28-0b2ae60c1386 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:10.933383 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2d75eb11-046b-4365-9c28-0b2ae60c1386 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:10.933699 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2d75eb11-046b-4365-9c28-0b2ae60c1386 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:11.192063 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2d75eb11-046b-4365-9c28-0b2ae60c1386 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:11.199934 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2d75eb11-046b-4365-9c28-0b2ae60c1386 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1567 microversion: 2.1 time: 0.280681 Jul 25 06:07:11.200502 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 546/1116] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:10 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1567 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:11.862067 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-f619c5c2-e72c-47fd-a021-a462937a2f5d req-ed0ef43c-0cb8-4c5d-855a-b69cacd8a043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1007f9b0-08e2-4d72-91e9-586792d0695b", "name": "network-vif-deleted", "tag": "3dfa9b78-4afb-4b3a-b13e-7a68f5d8ecc8"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:07:11.870074 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-f619c5c2-e72c-47fd-a021-a462937a2f5d req-ed0ef43c-0cb8-4c5d-855a-b69cacd8a043 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:11.870546 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-f619c5c2-e72c-47fd-a021-a462937a2f5d req-ed0ef43c-0cb8-4c5d-855a-b69cacd8a043 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:11.881548 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-f619c5c2-e72c-47fd-a021-a462937a2f5d req-ed0ef43c-0cb8-4c5d-855a-b69cacd8a043 service nova] Creating event network-vif-deleted:3dfa9b78-4afb-4b3a-b13e-7a68f5d8ecc8 for instance 1007f9b0-08e2-4d72-91e9-586792d0695b on hv-cinder-85083 Jul 25 06:07:11.883659 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-164b55e3-8fd4-4fe6-a889-dd7b6511f11d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:11.884323 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-164b55e3-8fd4-4fe6-a889-dd7b6511f11d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:11.887126 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-f619c5c2-e72c-47fd-a021-a462937a2f5d req-ed0ef43c-0cb8-4c5d-855a-b69cacd8a043 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168717 Jul 25 06:07:11.890927 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 571/1117] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:07:11.893130 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-164b55e3-8fd4-4fe6-a889-dd7b6511f11d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:11.893579 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-164b55e3-8fd4-4fe6-a889-dd7b6511f11d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:11.894393 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-164b55e3-8fd4-4fe6-a889-dd7b6511f11d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:11.894881 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-164b55e3-8fd4-4fe6-a889-dd7b6511f11d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:12.030170 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-164b55e3-8fd4-4fe6-a889-dd7b6511f11d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:12.038155 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-164b55e3-8fd4-4fe6-a889-dd7b6511f11d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1359 microversion: 2.1 time: 0.158468 Jul 25 06:07:12.038771 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 547/1118] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:11 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:12.217586 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-98e54591-fb57-4c54-9a39-2d3fe04efe71 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:12.218395 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-98e54591-fb57-4c54-9a39-2d3fe04efe71 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:12.224578 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-98e54591-fb57-4c54-9a39-2d3fe04efe71 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:12.225168 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-98e54591-fb57-4c54-9a39-2d3fe04efe71 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:12.225827 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-98e54591-fb57-4c54-9a39-2d3fe04efe71 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:12.226363 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-98e54591-fb57-4c54-9a39-2d3fe04efe71 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:12.292500 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-98e54591-fb57-4c54-9a39-2d3fe04efe71 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:12.300235 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-98e54591-fb57-4c54-9a39-2d3fe04efe71 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1381 microversion: 2.1 time: 0.086855 Jul 25 06:07:12.300809 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 572/1119] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:12 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1381 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:13.055036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-128f84ed-c26d-484f-8002-d96e97458dc0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:13.055640 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-128f84ed-c26d-484f-8002-d96e97458dc0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:13.062088 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-128f84ed-c26d-484f-8002-d96e97458dc0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:13.062562 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-128f84ed-c26d-484f-8002-d96e97458dc0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:13.063308 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-128f84ed-c26d-484f-8002-d96e97458dc0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:13.063732 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-128f84ed-c26d-484f-8002-d96e97458dc0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:13.187218 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-128f84ed-c26d-484f-8002-d96e97458dc0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:13.194651 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-128f84ed-c26d-484f-8002-d96e97458dc0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1359 microversion: 2.1 time: 0.143475 Jul 25 06:07:13.195220 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 548/1120] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:13 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:13.317124 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8c9be8c9-84e1-4e53-bba3-37759b2ff2f8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:13.317741 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8c9be8c9-84e1-4e53-bba3-37759b2ff2f8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:13.324647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8c9be8c9-84e1-4e53-bba3-37759b2ff2f8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:13.325088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8c9be8c9-84e1-4e53-bba3-37759b2ff2f8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:13.325838 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8c9be8c9-84e1-4e53-bba3-37759b2ff2f8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:13.326267 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8c9be8c9-84e1-4e53-bba3-37759b2ff2f8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:13.386361 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8c9be8c9-84e1-4e53-bba3-37759b2ff2f8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:13.393958 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8c9be8c9-84e1-4e53-bba3-37759b2ff2f8 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1219 microversion: 2.1 time: 0.080859 Jul 25 06:07:13.394620 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 573/1121] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:13 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:14.211498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-47bdd4b9-10fe-47c9-ace3-488157ae520a tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:14.212038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-47bdd4b9-10fe-47c9-ace3-488157ae520a tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:14.219020 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-47bdd4b9-10fe-47c9-ace3-488157ae520a tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:14.219464 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-47bdd4b9-10fe-47c9-ace3-488157ae520a tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:14.220224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-47bdd4b9-10fe-47c9-ace3-488157ae520a tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:14.220662 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-47bdd4b9-10fe-47c9-ace3-488157ae520a tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:14.354292 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-47bdd4b9-10fe-47c9-ace3-488157ae520a tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:14.361880 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-47bdd4b9-10fe-47c9-ace3-488157ae520a tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1359 microversion: 2.1 time: 0.154366 Jul 25 06:07:14.362460 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 549/1122] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:14 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:14.410648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-48129325-6314-44c7-8d6c-4973fb65eb71 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:14.411370 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-48129325-6314-44c7-8d6c-4973fb65eb71 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:14.417862 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-48129325-6314-44c7-8d6c-4973fb65eb71 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:14.418440 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-48129325-6314-44c7-8d6c-4973fb65eb71 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:14.419320 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-48129325-6314-44c7-8d6c-4973fb65eb71 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:14.420021 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-48129325-6314-44c7-8d6c-4973fb65eb71 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:14.481584 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-48129325-6314-44c7-8d6c-4973fb65eb71 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:14.489815 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-48129325-6314-44c7-8d6c-4973fb65eb71 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1219 microversion: 2.1 time: 0.083092 Jul 25 06:07:14.490398 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 574/1123] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:14 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:15.378889 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-491fef4b-29aa-465a-b79f-7e2f7663085b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:15.379542 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-491fef4b-29aa-465a-b79f-7e2f7663085b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:15.385964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-491fef4b-29aa-465a-b79f-7e2f7663085b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:15.386408 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-491fef4b-29aa-465a-b79f-7e2f7663085b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:15.387194 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-491fef4b-29aa-465a-b79f-7e2f7663085b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:15.387629 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-491fef4b-29aa-465a-b79f-7e2f7663085b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:15.508672 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c9c61eaf-3946-460f-b9a4-50795dd9d391 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:15.509238 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c9c61eaf-3946-460f-b9a4-50795dd9d391 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:15.516684 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c9c61eaf-3946-460f-b9a4-50795dd9d391 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:15.517094 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c9c61eaf-3946-460f-b9a4-50795dd9d391 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:15.517229 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-491fef4b-29aa-465a-b79f-7e2f7663085b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:15.517882 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c9c61eaf-3946-460f-b9a4-50795dd9d391 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:15.518320 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c9c61eaf-3946-460f-b9a4-50795dd9d391 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:15.525152 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-491fef4b-29aa-465a-b79f-7e2f7663085b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1359 microversion: 2.1 time: 0.150017 Jul 25 06:07:15.525721 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 550/1124] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:15 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:15.583601 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-c9c61eaf-3946-460f-b9a4-50795dd9d391 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:15.592870 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c9c61eaf-3946-460f-b9a4-50795dd9d391 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1219 microversion: 2.1 time: 0.088377 Jul 25 06:07:15.592870 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 575/1125] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:15 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:16.542814 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8c2e7bd5-734c-4ca4-98fc-542f21c2238b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:16.543425 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8c2e7bd5-734c-4ca4-98fc-542f21c2238b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:16.550195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8c2e7bd5-734c-4ca4-98fc-542f21c2238b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:16.550677 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8c2e7bd5-734c-4ca4-98fc-542f21c2238b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:16.551424 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8c2e7bd5-734c-4ca4-98fc-542f21c2238b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:16.551850 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8c2e7bd5-734c-4ca4-98fc-542f21c2238b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:16.609544 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a22d3753-a40c-4298-9287-cfd745b0cfa5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:16.610153 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a22d3753-a40c-4298-9287-cfd745b0cfa5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:16.616481 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a22d3753-a40c-4298-9287-cfd745b0cfa5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:16.616922 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a22d3753-a40c-4298-9287-cfd745b0cfa5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:16.617677 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a22d3753-a40c-4298-9287-cfd745b0cfa5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:16.618110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a22d3753-a40c-4298-9287-cfd745b0cfa5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:16.679392 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8c2e7bd5-734c-4ca4-98fc-542f21c2238b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:16.686773 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a22d3753-a40c-4298-9287-cfd745b0cfa5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:16.687261 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-8c2e7bd5-734c-4ca4-98fc-542f21c2238b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1359 microversion: 2.1 time: 0.148685 Jul 25 06:07:16.688026 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 551/1126] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:16 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:16.696561 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a22d3753-a40c-4298-9287-cfd745b0cfa5 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1219 microversion: 2.1 time: 0.088109 Jul 25 06:07:16.696561 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 576/1127] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:16 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:07:17.704711 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-8d6a7c2c-023c-4907-af1f-252d8ce2c5f1 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:17.706239 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-8d6a7c2c-023c-4907-af1f-252d8ce2c5f1 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:17.710213 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-41a59256-c4c4-490a-a57c-4d1853ca2898 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:17.710773 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-41a59256-c4c4-490a-a57c-4d1853ca2898 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:17.716092 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8d6a7c2c-023c-4907-af1f-252d8ce2c5f1 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:17.716431 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8d6a7c2c-023c-4907-af1f-252d8ce2c5f1 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:17.717216 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8d6a7c2c-023c-4907-af1f-252d8ce2c5f1 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:17.717336 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-41a59256-c4c4-490a-a57c-4d1853ca2898 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:17.717656 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-8d6a7c2c-023c-4907-af1f-252d8ce2c5f1 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:17.717771 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-41a59256-c4c4-490a-a57c-4d1853ca2898 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:17.718541 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-41a59256-c4c4-490a-a57c-4d1853ca2898 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:17.718985 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-41a59256-c4c4-490a-a57c-4d1853ca2898 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:17.758243 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-41a59256-c4c4-490a-a57c-4d1853ca2898 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:17.758720 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-41a59256-c4c4-490a-a57c-4d1853ca2898 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:17.759360 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-41a59256-c4c4-490a-a57c-4d1853ca2898 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lazy-loading 'fault' on Instance uuid 1007f9b0-08e2-4d72-91e9-586792d0695b {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:07:17.808937 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-41a59256-c4c4-490a-a57c-4d1853ca2898 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03b404df6d54b638804804bbc08e1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a1423a26e041959827c5d8611cffdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:17.819135 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-41a59256-c4c4-490a-a57c-4d1853ca2898 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 200 len: 1178 microversion: 2.1 time: 0.113033 Jul 25 06:07:17.820247 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 552/1128] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:17 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 1178 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:07:17.834919 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-b0031c33-ee2a-41ff-abcf-a7bcb0d31917 req-0b9e2c2c-d6ef-4213-a4b4-19808044d180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b8c81f-8362-4af8-97ce-73dab9c68cc2", "name": "network-vif-plugged", "status": "completed", "tag": "d4f48ee1-da5f-427a-a821-05c06871ba9f"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:07:17.844338 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-b0031c33-ee2a-41ff-abcf-a7bcb0d31917 req-0b9e2c2c-d6ef-4213-a4b4-19808044d180 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:17.844780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-b0031c33-ee2a-41ff-abcf-a7bcb0d31917 req-0b9e2c2c-d6ef-4213-a4b4-19808044d180 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:17.857074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-b0031c33-ee2a-41ff-abcf-a7bcb0d31917 req-0b9e2c2c-d6ef-4213-a4b4-19808044d180 service nova] Creating event network-vif-plugged:d4f48ee1-da5f-427a-a821-05c06871ba9f for instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 on hv-cinder-85083 Jul 25 06:07:17.862286 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-b0031c33-ee2a-41ff-abcf-a7bcb0d31917 req-0b9e2c2c-d6ef-4213-a4b4-19808044d180 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040553 Jul 25 06:07:17.862910 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 553/1129] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:07:17.869468 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-8d6a7c2c-023c-4907-af1f-252d8ce2c5f1 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:17.873580 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:17.878259 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-8d6a7c2c-023c-4907-af1f-252d8ce2c5f1 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1359 microversion: 2.1 time: 0.177722 Jul 25 06:07:17.879043 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 577/1130] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:17 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:18.836525 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f25fc353-3a49-4c77-a756-55ac2a43a939 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:18.837225 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f25fc353-3a49-4c77-a756-55ac2a43a939 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] [instance: 1007f9b0-08e2-4d72-91e9-586792d0695b] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:18.844431 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f25fc353-3a49-4c77-a756-55ac2a43a939 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:18.849214 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f25fc353-3a49-4c77-a756-55ac2a43a939 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:18.849214 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f25fc353-3a49-4c77-a756-55ac2a43a939 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:18.849214 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f25fc353-3a49-4c77-a756-55ac2a43a939 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:18.859436 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-f25fc353-3a49-4c77-a756-55ac2a43a939 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] HTTP exception thrown: Instance 1007f9b0-08e2-4d72-91e9-586792d0695b could not be found. Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f25fc353-3a49-4c77-a756-55ac2a43a939 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Request method failure captured: Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b HTTP/1.1 Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jGOwkH0ptRm6HoH_TileJHkLYBhUvlIEP10mHvvn6eck5YROgYowVZbDXG2T_ozWESXWDyM4Vuk--qiO7ZBbtgaBBoMUk2arhE5ARz793YtEszsOb8EIFq0nvfBKyOovWqdim3Pplj6quhf7GGLOQxBkYrFLdmZc44ELUo3bhsOrOo Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: 52a1423a26e041959827c5d8611cffdf Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-TestShelveInstance-575132572 Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:07:18.861060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:07:18.862788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52a1423a26e041959827c5d8611cffdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52a1423a26e041959827c5d8611cffdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/52a1423a26e041959827c5d8611cffdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_52a1423a26e041959827c5d8611cffdf", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:07:18.862788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-TestShelveInstance-575132572 Jul 25 06:07:18.862788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: 52a1423a26e041959827c5d8611cffdf Jul 25 06:07:18.862788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-TestShelveInstance-575132572 Jul 25 06:07:18.862788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-TestShelveInstance-575132572-project Jul 25 06:07:18.862788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:07:18.862788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:07:18.862788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: d03b404df6d54b638804804bbc08e1cf Jul 25 06:07:18.862788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-TestShelveInstance-575132572-project Jul 25 06:07:18.862788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:07:18.862788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 1007f9b0-08e2-4d72-91e9-586792d0695b could not be found. Jul 25 06:07:18.862788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '1007f9b0-08e2-4d72-91e9-586792d0695b'} Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1007f9b0-08e2-4d72-91e9-586792d0695b could not be found. Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:07:18.863790 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1007f9b0-08e2-4d72-91e9-586792d0695b could not be found. Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1007f9b0-08e2-4d72-91e9-586792d0695b could not be found. Jul 25 06:07:18.865387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:07:18.866848 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f25fc353-3a49-4c77-a756-55ac2a43a939 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Returning 404 to user: Instance 1007f9b0-08e2-4d72-91e9-586792d0695b could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:07:18.866848 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f25fc353-3a49-4c77-a756-55ac2a43a939 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b" status: 404 len: 111 microversion: 2.1 time: 0.030131 Jul 25 06:07:18.866848 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 554/1131] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:18 2022] GET /compute/v2.1/servers/1007f9b0-08e2-4d72-91e9-586792d0695b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:07:18.895294 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a9dedc0d-f946-43ee-aeb2-daefddbe29d2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:18.895895 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a9dedc0d-f946-43ee-aeb2-daefddbe29d2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:18.903220 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a9dedc0d-f946-43ee-aeb2-daefddbe29d2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:18.903676 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a9dedc0d-f946-43ee-aeb2-daefddbe29d2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:18.904496 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a9dedc0d-f946-43ee-aeb2-daefddbe29d2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:18.904939 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a9dedc0d-f946-43ee-aeb2-daefddbe29d2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:19.039646 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a9dedc0d-f946-43ee-aeb2-daefddbe29d2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:19.047313 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a9dedc0d-f946-43ee-aeb2-daefddbe29d2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1359 microversion: 2.1 time: 0.156068 Jul 25 06:07:19.047856 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 578/1132] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:18 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:19.077991 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cf331e2d-60e0-4ef1-a235-b94655527410 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] Calling method '.version_select at 0x7f9d36a0f310>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:19.154923 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-cf331e2d-60e0-4ef1-a235-b94655527410 tempest-TestShelveInstance-575132572 tempest-TestShelveInstance-575132572-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2041156438" status: 202 len: 0 microversion: 2.1 time: 0.081419 Jul 25 06:07:19.155496 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 555/1133] 10.222.0.17 () {58 vars in 1253 bytes} [Mon Jul 25 06:07:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2041156438 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:07:20.063940 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-08470615-9064-41bc-b721-74f62889924e tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:20.064567 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-08470615-9064-41bc-b721-74f62889924e tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:20.070982 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-08470615-9064-41bc-b721-74f62889924e tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:20.071427 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-08470615-9064-41bc-b721-74f62889924e tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:20.072980 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-08470615-9064-41bc-b721-74f62889924e tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:20.072980 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-08470615-9064-41bc-b721-74f62889924e tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:20.202064 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-08470615-9064-41bc-b721-74f62889924e tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:20.210405 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-08470615-9064-41bc-b721-74f62889924e tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1547 microversion: 2.1 time: 0.150341 Jul 25 06:07:20.211129 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 579/1134] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:20 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:20.227226 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-b590b438-ef79-4ee2-9171-6f7699eec82d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:20.228795 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-b590b438-ef79-4ee2-9171-6f7699eec82d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:20.237838 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b590b438-ef79-4ee2-9171-6f7699eec82d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:20.240295 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b590b438-ef79-4ee2-9171-6f7699eec82d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:20.240295 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b590b438-ef79-4ee2-9171-6f7699eec82d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:20.240295 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-b590b438-ef79-4ee2-9171-6f7699eec82d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:20.244093 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=100 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:20.471685 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-b590b438-ef79-4ee2-9171-6f7699eec82d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:20.479178 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-b590b438-ef79-4ee2-9171-6f7699eec82d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1547 microversion: 2.1 time: 0.255981 Jul 25 06:07:20.479922 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 556/1135] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:20 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1547 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:20.496592 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-84a32010-000a-45a7-890c-8cb3b6caf78f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:20.500509 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-84a32010-000a-45a7-890c-8cb3b6caf78f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:20.501302 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-84a32010-000a-45a7-890c-8cb3b6caf78f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Searching by: {'deleted': False, 'project_id': 'a39f82493df2479395de88147e2f8292'} {{(pid=130163) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 06:07:20.508213 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-84a32010-000a-45a7-890c-8cb3b6caf78f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:20.508749 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-84a32010-000a-45a7-890c-8cb3b6caf78f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:20.509644 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-84a32010-000a-45a7-890c-8cb3b6caf78f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:20.510153 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-84a32010-000a-45a7-890c-8cb3b6caf78f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:20.608273 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.multi_cell_list [None req-84a32010-000a-45a7-890c-8cb3b6caf78f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130163) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 06:07:20.728166 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-84a32010-000a-45a7-890c-8cb3b6caf78f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.235666 Jul 25 06:07:20.728806 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 580/1136] 10.222.0.17 () {58 vars in 1124 bytes} [Mon Jul 25 06:07:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:07:20.739831 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-98f6ab78-17f3-4e6c-afa5-714a0bd7fea4 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:20.740481 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-98f6ab78-17f3-4e6c-afa5-714a0bd7fea4 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:20.747544 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-98f6ab78-17f3-4e6c-afa5-714a0bd7fea4 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:20.747993 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-98f6ab78-17f3-4e6c-afa5-714a0bd7fea4 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:20.748794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-98f6ab78-17f3-4e6c-afa5-714a0bd7fea4 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:20.749204 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-98f6ab78-17f3-4e6c-afa5-714a0bd7fea4 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:20.913668 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-98f6ab78-17f3-4e6c-afa5-714a0bd7fea4 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:20.922085 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-98f6ab78-17f3-4e6c-afa5-714a0bd7fea4 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1547 microversion: 2.1 time: 0.186234 Jul 25 06:07:20.922895 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 557/1137] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:20 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1547 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:23.817453 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-32d345c0-6d1a-4d6a-a5b5-950368948aec tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d512d9cf-8c4d-49d3-be43-8440c2275922"}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:07:23.818569 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-32d345c0-6d1a-4d6a-a5b5-950368948aec tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:23.825954 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-32d345c0-6d1a-4d6a-a5b5-950368948aec tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:23.826406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-32d345c0-6d1a-4d6a-a5b5-950368948aec tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:23.827233 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-32d345c0-6d1a-4d6a-a5b5-950368948aec tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:23.827679 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-32d345c0-6d1a-4d6a-a5b5-950368948aec tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:24.539988 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-32d345c0-6d1a-4d6a-a5b5-950368948aec tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "POST /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.726251 Jul 25 06:07:24.546120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 581/1138] 10.222.0.17 () {60 vars in 1322 bytes} [Mon Jul 25 06:07:23 2022] POST /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2/os-volume_attachments => generated 194 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:07:32.111730 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-01b29077-8226-49e7-9342-de0fc69029ee tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:32.112351 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-01b29077-8226-49e7-9342-de0fc69029ee tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:32.114904 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:32.115567 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=10 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:32.120369 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-01b29077-8226-49e7-9342-de0fc69029ee tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:32.120819 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-01b29077-8226-49e7-9342-de0fc69029ee tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:32.122333 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-01b29077-8226-49e7-9342-de0fc69029ee tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:32.122815 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-01b29077-8226-49e7-9342-de0fc69029ee tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:32.254675 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-01b29077-8226-49e7-9342-de0fc69029ee tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:32.262629 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-01b29077-8226-49e7-9342-de0fc69029ee tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1593 microversion: 2.1 time: 0.154620 Jul 25 06:07:32.263195 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 558/1139] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:32 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:34.776374 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-fc98dbc8-cb7a-4ff8-a14b-3d552ae807cf req-5115939d-3806-4ddb-85b6-f4620191e3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b8c81f-8362-4af8-97ce-73dab9c68cc2", "tag": "d4f48ee1-da5f-427a-a821-05c06871ba9f"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:07:34.785832 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=2 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:34.788138 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:34.789187 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:34.795489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-fc98dbc8-cb7a-4ff8-a14b-3d552ae807cf req-5115939d-3806-4ddb-85b6-f4620191e3e0 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:34.796841 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-fc98dbc8-cb7a-4ff8-a14b-3d552ae807cf req-5115939d-3806-4ddb-85b6-f4620191e3e0 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:34.812191 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-fc98dbc8-cb7a-4ff8-a14b-3d552ae807cf req-5115939d-3806-4ddb-85b6-f4620191e3e0 service nova] Creating event network-changed:d4f48ee1-da5f-427a-a821-05c06871ba9f for instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 on hv-cinder-85083 Jul 25 06:07:34.817933 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-fc98dbc8-cb7a-4ff8-a14b-3d552ae807cf req-5115939d-3806-4ddb-85b6-f4620191e3e0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046678 Jul 25 06:07:34.819306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 582/1140] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:07:37.821344 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-02d5c807-983e-4c60-b36a-825993301a14 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-590754252"}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:07:37.822172 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-02d5c807-983e-4c60-b36a-825993301a14 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:37.830579 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-02d5c807-983e-4c60-b36a-825993301a14 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:37.831247 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-02d5c807-983e-4c60-b36a-825993301a14 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:37.832223 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-02d5c807-983e-4c60-b36a-825993301a14 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:37.832826 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-02d5c807-983e-4c60-b36a-825993301a14 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:37.971673 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.network.security_group_api [None req-02d5c807-983e-4c60-b36a-825993301a14 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Adding security group 37657994-5e2e-4af1-9043-0345eeb1913f to port d4f48ee1-da5f-427a-a821-05c06871ba9f Jul 25 06:07:38.398879 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-02d5c807-983e-4c60-b36a-825993301a14 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "POST /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2/action" status: 202 len: 0 microversion: 2.1 time: 0.582940 Jul 25 06:07:38.402801 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 559/1141] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 06:07:37 2022] POST /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:07:38.410456 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-f84f1e32-11e8-462b-b8fd-ec4233ea9bfb req-d2f489f8-f1b5-4339-9ece-ca4000c8ec00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b8c81f-8362-4af8-97ce-73dab9c68cc2", "tag": "d4f48ee1-da5f-427a-a821-05c06871ba9f"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:07:38.414838 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-487cd1e3-c43b-4a7c-b257-da2620bcbd43 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:38.415557 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-487cd1e3-c43b-4a7c-b257-da2620bcbd43 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:38.448108 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-f84f1e32-11e8-462b-b8fd-ec4233ea9bfb req-d2f489f8-f1b5-4339-9ece-ca4000c8ec00 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:38.448684 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-f84f1e32-11e8-462b-b8fd-ec4233ea9bfb req-d2f489f8-f1b5-4339-9ece-ca4000c8ec00 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:38.458345 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-487cd1e3-c43b-4a7c-b257-da2620bcbd43 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:38.458850 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-487cd1e3-c43b-4a7c-b257-da2620bcbd43 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:38.459701 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-487cd1e3-c43b-4a7c-b257-da2620bcbd43 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:38.460143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-487cd1e3-c43b-4a7c-b257-da2620bcbd43 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:38.469123 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-f84f1e32-11e8-462b-b8fd-ec4233ea9bfb req-d2f489f8-f1b5-4339-9ece-ca4000c8ec00 service nova] Creating event network-changed:d4f48ee1-da5f-427a-a821-05c06871ba9f for instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 on hv-cinder-85083 Jul 25 06:07:38.474914 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-f84f1e32-11e8-462b-b8fd-ec4233ea9bfb req-d2f489f8-f1b5-4339-9ece-ca4000c8ec00 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067809 Jul 25 06:07:38.475942 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 560/1142] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:07:38.812158 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-487cd1e3-c43b-4a7c-b257-da2620bcbd43 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:38.821440 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-487cd1e3-c43b-4a7c-b257-da2620bcbd43 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1758 microversion: 2.1 time: 0.416513 Jul 25 06:07:38.822622 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 583/1143] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:38 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1758 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:44.240364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-16f2af64-ecc9-4ad5-b13f-40de747523dc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Action: 'create', calling method: .version_select at 0x7f9d35f91550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1541654995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMasq6c08Fc90Sc5rB0Le2zKYMlQm4y+5kQgmwC9yVFGkcZKnixu5x0sp8/fRS+Lq2vdD61ZxzxnBZVWOxXJ3WgBD/gG5XiU7RuWCCB0ucb76lLI98V/Fk3S42SVc/CYnw=="}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:07:44.254936 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-16f2af64-ecc9-4ad5-b13f-40de747523dc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Getting quotas for project 5eef98733468492383e255f9045cd025. Resources: {'key_pairs'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:07:44.258854 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-16f2af64-ecc9-4ad5-b13f-40de747523dc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Getting quotas for user 8650e8e864f045c59cf38e7a50949b94 and project 5eef98733468492383e255f9045cd025. Resources: {'key_pairs'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:07:44.364981 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-16f2af64-ecc9-4ad5-b13f-40de747523dc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.309020 Jul 25 06:07:44.365583 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 561/1144] 10.222.0.17 () {60 vars in 1158 bytes} [Mon Jul 25 06:07:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:07:58.362790 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-be4b3355-9f12-446f-8f32-a7aa3898ed8f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:07:58.363771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-be4b3355-9f12-446f-8f32-a7aa3898ed8f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:58.366167 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=4 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:58.366826 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=8 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:58.371487 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-be4b3355-9f12-446f-8f32-a7aa3898ed8f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:58.371933 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-be4b3355-9f12-446f-8f32-a7aa3898ed8f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:58.372695 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-be4b3355-9f12-446f-8f32-a7aa3898ed8f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:58.373130 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-be4b3355-9f12-446f-8f32-a7aa3898ed8f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:58.567894 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-be4b3355-9f12-446f-8f32-a7aa3898ed8f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "POST /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2/action" status: 202 len: 0 microversion: 2.1 time: 0.208762 Jul 25 06:07:58.568606 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 584/1145] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 06:07:58 2022] POST /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:07:58.573959 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=12 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:58.574831 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=4 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:58.575467 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:58.579864 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d1d69f6d-c02b-4d6b-b9bf-fff7100691a8 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:58.583465 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d1d69f6d-c02b-4d6b-b9bf-fff7100691a8 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:58.587151 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d1d69f6d-c02b-4d6b-b9bf-fff7100691a8 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:58.587596 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d1d69f6d-c02b-4d6b-b9bf-fff7100691a8 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:58.588354 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d1d69f6d-c02b-4d6b-b9bf-fff7100691a8 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:58.588787 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d1d69f6d-c02b-4d6b-b9bf-fff7100691a8 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:58.733634 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d1d69f6d-c02b-4d6b-b9bf-fff7100691a8 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:58.742134 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d1d69f6d-c02b-4d6b-b9bf-fff7100691a8 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1750 microversion: 2.1 time: 0.169349 Jul 25 06:07:58.744064 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 562/1146] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:58 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:59.761520 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-56aee62b-3d5b-4fb9-b0d2-757a27b37f98 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:59.762219 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-56aee62b-3d5b-4fb9-b0d2-757a27b37f98 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:59.769495 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-56aee62b-3d5b-4fb9-b0d2-757a27b37f98 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:59.769940 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-56aee62b-3d5b-4fb9-b0d2-757a27b37f98 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:59.770727 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-56aee62b-3d5b-4fb9-b0d2-757a27b37f98 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:59.771152 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-56aee62b-3d5b-4fb9-b0d2-757a27b37f98 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:59.912376 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-56aee62b-3d5b-4fb9-b0d2-757a27b37f98 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:59.920474 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-56aee62b-3d5b-4fb9-b0d2-757a27b37f98 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1755 microversion: 2.1 time: 0.163574 Jul 25 06:07:59.921044 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 585/1147] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:59 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:00.938637 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8d3ebc26-c89d-4144-a7e9-11ef6332dfa6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:00.939254 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8d3ebc26-c89d-4144-a7e9-11ef6332dfa6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:00.946714 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8d3ebc26-c89d-4144-a7e9-11ef6332dfa6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:00.947158 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8d3ebc26-c89d-4144-a7e9-11ef6332dfa6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:00.947911 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8d3ebc26-c89d-4144-a7e9-11ef6332dfa6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:00.948346 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8d3ebc26-c89d-4144-a7e9-11ef6332dfa6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:01.103981 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-8d3ebc26-c89d-4144-a7e9-11ef6332dfa6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:01.117580 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-8d3ebc26-c89d-4144-a7e9-11ef6332dfa6 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1755 microversion: 2.1 time: 0.183590 Jul 25 06:08:01.118175 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 563/1148] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:00 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:02.139457 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-688bb511-b292-4910-8b98-bd9dabdda055 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:02.140103 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-688bb511-b292-4910-8b98-bd9dabdda055 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:02.146488 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-688bb511-b292-4910-8b98-bd9dabdda055 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:02.147056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-688bb511-b292-4910-8b98-bd9dabdda055 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:02.147913 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-688bb511-b292-4910-8b98-bd9dabdda055 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:02.148426 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-688bb511-b292-4910-8b98-bd9dabdda055 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:02.253045 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2684365d-0318-4e38-8f78-ead605932516 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1169663729", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1541654995", "security_groups": [{"name": "tempest-secgroup-smoke-1531502122"}], "block_device_mapping_v2": [{"uuid": "9b338e5e-0e0a-43d6-82da-151e83506b02", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e18ffaf8-7ae8-4950-a6c2-4803be698590"}]}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:08:02.309422 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-688bb511-b292-4910-8b98-bd9dabdda055 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:02.317265 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-688bb511-b292-4910-8b98-bd9dabdda055 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1755 microversion: 2.1 time: 0.182356 Jul 25 06:08:02.318275 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 586/1149] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:02 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:02.366340 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.network.neutron [None req-2684365d-0318-4e38-8f78-ead605932516 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] validate_networks() for [('e18ffaf8-7ae8-4950-a6c2-4803be698590', None, None, None, None, None)] {{(pid=130162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:08:02.814084 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-2684365d-0318-4e38-8f78-ead605932516 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Flavor limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:08:02.814566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-2684365d-0318-4e38-8f78-ead605932516 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Image limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:08:02.815098 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-2684365d-0318-4e38-8f78-ead605932516 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Flavor pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:08:02.815481 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-2684365d-0318-4e38-8f78-ead605932516 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Image pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:08:02.815887 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-2684365d-0318-4e38-8f78-ead605932516 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:08:02.824432 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2684365d-0318-4e38-8f78-ead605932516 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:02.824866 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2684365d-0318-4e38-8f78-ead605932516 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:02.825650 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2684365d-0318-4e38-8f78-ead605932516 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:02.826076 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2684365d-0318-4e38-8f78-ead605932516 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:02.842590 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-2684365d-0318-4e38-8f78-ead605932516 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Getting quotas for project 5eef98733468492383e255f9045cd025. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:08:02.847036 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-2684365d-0318-4e38-8f78-ead605932516 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Getting quotas for user 8650e8e864f045c59cf38e7a50949b94 and project 5eef98733468492383e255f9045cd025. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:08:02.902948 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2684365d-0318-4e38-8f78-ead605932516 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Going to run 1 instances... {{(pid=130162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:08:02.905087 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2684365d-0318-4e38-8f78-ead605932516 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9b338e5e-0e0a-43d6-82da-151e83506b02',volume_size=None,volume_type=None)] {{(pid=130162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:08:03.204960 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2684365d-0318-4e38-8f78-ead605932516 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.955925 Jul 25 06:08:03.205606 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 564/1150] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 06:08:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 06:08:03.216099 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-6cee017f-9e1e-4128-b138-f9ff1a4f6e90 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:03.216810 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-6cee017f-9e1e-4128-b138-f9ff1a4f6e90 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:03.269089 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-6cee017f-9e1e-4128-b138-f9ff1a4f6e90 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:03.275646 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-6cee017f-9e1e-4128-b138-f9ff1a4f6e90 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1095 microversion: 2.1 time: 0.063441 Jul 25 06:08:03.276205 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 587/1151] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:03 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:03.334563 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-cc0559e4-fe9c-4923-b1f3-c84120c24238 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:03.335187 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-cc0559e4-fe9c-4923-b1f3-c84120c24238 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:03.342459 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cc0559e4-fe9c-4923-b1f3-c84120c24238 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:03.344286 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cc0559e4-fe9c-4923-b1f3-c84120c24238 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:03.345066 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cc0559e4-fe9c-4923-b1f3-c84120c24238 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:03.345506 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-cc0559e4-fe9c-4923-b1f3-c84120c24238 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:03.485996 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-cc0559e4-fe9c-4923-b1f3-c84120c24238 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:03.494733 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-cc0559e4-fe9c-4923-b1f3-c84120c24238 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1755 microversion: 2.1 time: 0.164461 Jul 25 06:08:03.495290 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 565/1152] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:03 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:04.292438 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2cf4ca23-fefa-4feb-838d-3a807faaeefa tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:04.292967 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2cf4ca23-fefa-4feb-838d-3a807faaeefa tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:04.300220 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2cf4ca23-fefa-4feb-838d-3a807faaeefa tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:04.300679 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2cf4ca23-fefa-4feb-838d-3a807faaeefa tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:04.301448 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2cf4ca23-fefa-4feb-838d-3a807faaeefa tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:04.301889 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2cf4ca23-fefa-4feb-838d-3a807faaeefa tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:04.361903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2cf4ca23-fefa-4feb-838d-3a807faaeefa tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:04.369514 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2cf4ca23-fefa-4feb-838d-3a807faaeefa tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1145 microversion: 2.1 time: 0.081112 Jul 25 06:08:04.370087 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 588/1153] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:04 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:08:04.512257 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0ac573e1-d9c8-401e-a007-be799e5e12bf tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:04.512850 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0ac573e1-d9c8-401e-a007-be799e5e12bf tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:04.519978 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0ac573e1-d9c8-401e-a007-be799e5e12bf tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:04.520453 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0ac573e1-d9c8-401e-a007-be799e5e12bf tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:04.521208 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0ac573e1-d9c8-401e-a007-be799e5e12bf tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:04.521636 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0ac573e1-d9c8-401e-a007-be799e5e12bf tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:04.678249 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0ac573e1-d9c8-401e-a007-be799e5e12bf tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:04.688226 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0ac573e1-d9c8-401e-a007-be799e5e12bf tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1755 microversion: 2.1 time: 0.179883 Jul 25 06:08:04.688792 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 566/1154] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:04 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:05.385993 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-1f62f430-082a-48dd-b2ed-dc69ee79cb08 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:05.387524 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-1f62f430-082a-48dd-b2ed-dc69ee79cb08 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:05.395366 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1f62f430-082a-48dd-b2ed-dc69ee79cb08 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:05.395711 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1f62f430-082a-48dd-b2ed-dc69ee79cb08 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:05.397124 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1f62f430-082a-48dd-b2ed-dc69ee79cb08 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:05.397596 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-1f62f430-082a-48dd-b2ed-dc69ee79cb08 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:05.470613 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-1f62f430-082a-48dd-b2ed-dc69ee79cb08 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:05.477986 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-1f62f430-082a-48dd-b2ed-dc69ee79cb08 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1211 microversion: 2.1 time: 0.095990 Jul 25 06:08:05.487445 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 589/1155] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:05 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:05.705221 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e19fffad-7808-4d09-94c5-18caa52371f9 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:05.705979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e19fffad-7808-4d09-94c5-18caa52371f9 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:05.714430 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e19fffad-7808-4d09-94c5-18caa52371f9 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:05.714902 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e19fffad-7808-4d09-94c5-18caa52371f9 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:05.715691 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e19fffad-7808-4d09-94c5-18caa52371f9 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:05.716122 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e19fffad-7808-4d09-94c5-18caa52371f9 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:05.865982 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e19fffad-7808-4d09-94c5-18caa52371f9 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:05.874041 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e19fffad-7808-4d09-94c5-18caa52371f9 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1755 microversion: 2.1 time: 0.172668 Jul 25 06:08:05.874882 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 567/1156] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:05 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:06.495103 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-918166ba-6836-410f-addf-1e5d059549d0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:06.495722 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-918166ba-6836-410f-addf-1e5d059549d0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:06.502269 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-918166ba-6836-410f-addf-1e5d059549d0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:06.503035 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-918166ba-6836-410f-addf-1e5d059549d0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:06.503863 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-918166ba-6836-410f-addf-1e5d059549d0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:06.504305 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-918166ba-6836-410f-addf-1e5d059549d0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:06.718154 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-918166ba-6836-410f-addf-1e5d059549d0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:06.723205 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-918166ba-6836-410f-addf-1e5d059549d0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1267 microversion: 2.1 time: 0.231790 Jul 25 06:08:06.723876 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 590/1157] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:06 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:06.892267 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-f3793f02-72c4-4850-b94a-6ab150e4207d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:06.892983 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-f3793f02-72c4-4850-b94a-6ab150e4207d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:06.900364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f3793f02-72c4-4850-b94a-6ab150e4207d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:06.900819 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f3793f02-72c4-4850-b94a-6ab150e4207d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:06.901584 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f3793f02-72c4-4850-b94a-6ab150e4207d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:06.902014 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-f3793f02-72c4-4850-b94a-6ab150e4207d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:06.985006 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-31221f8a-3a1d-4118-9441-f0303b83e050 req-de2e90c8-fa53-4d5b-af22-b5a103a6083d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7934824b-229d-4bb6-a229-f071b9338837", "tag": "dad2140c-c348-4a04-8125-b587fa7f9d48"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:08:06.995498 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-31221f8a-3a1d-4118-9441-f0303b83e050 req-de2e90c8-fa53-4d5b-af22-b5a103a6083d service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:06.996194 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-31221f8a-3a1d-4118-9441-f0303b83e050 req-de2e90c8-fa53-4d5b-af22-b5a103a6083d service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:07.015856 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-31221f8a-3a1d-4118-9441-f0303b83e050 req-de2e90c8-fa53-4d5b-af22-b5a103a6083d service nova] Creating event network-changed:dad2140c-c348-4a04-8125-b587fa7f9d48 for instance 7934824b-229d-4bb6-a229-f071b9338837 on hv-cinder-85083 Jul 25 06:08:07.023492 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-31221f8a-3a1d-4118-9441-f0303b83e050 req-de2e90c8-fa53-4d5b-af22-b5a103a6083d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042354 Jul 25 06:08:07.024756 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 591/1158] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:08:07.080264 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-f3793f02-72c4-4850-b94a-6ab150e4207d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:07.088707 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-f3793f02-72c4-4850-b94a-6ab150e4207d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1755 microversion: 2.1 time: 0.200381 Jul 25 06:08:07.089300 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 568/1159] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:06 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1755 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:07.741171 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2b30a603-a151-4911-8912-800485420ccc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:07.741860 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2b30a603-a151-4911-8912-800485420ccc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:07.748341 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2b30a603-a151-4911-8912-800485420ccc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:07.748786 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2b30a603-a151-4911-8912-800485420ccc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:07.749583 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2b30a603-a151-4911-8912-800485420ccc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:07.750012 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2b30a603-a151-4911-8912-800485420ccc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:07.885637 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2b30a603-a151-4911-8912-800485420ccc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:07.893564 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2b30a603-a151-4911-8912-800485420ccc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1267 microversion: 2.1 time: 0.157170 Jul 25 06:08:07.894142 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 592/1160] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:07 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:08.105001 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9bfcb205-3d9a-4297-bae2-ea19a52a1269 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:08.105608 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-9bfcb205-3d9a-4297-bae2-ea19a52a1269 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:08.111991 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9bfcb205-3d9a-4297-bae2-ea19a52a1269 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:08.112432 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9bfcb205-3d9a-4297-bae2-ea19a52a1269 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:08.113175 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9bfcb205-3d9a-4297-bae2-ea19a52a1269 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:08.113599 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9bfcb205-3d9a-4297-bae2-ea19a52a1269 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:08.250330 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-9bfcb205-3d9a-4297-bae2-ea19a52a1269 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:08.258667 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-9bfcb205-3d9a-4297-bae2-ea19a52a1269 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1755 microversion: 2.1 time: 0.157479 Jul 25 06:08:08.259208 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 569/1161] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:08 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:08.910740 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-631421a7-3120-43fd-b222-c2f28963fc94 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:08.911318 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-631421a7-3120-43fd-b222-c2f28963fc94 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:08.917802 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-631421a7-3120-43fd-b222-c2f28963fc94 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:08.918248 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-631421a7-3120-43fd-b222-c2f28963fc94 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:08.919043 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-631421a7-3120-43fd-b222-c2f28963fc94 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:08.919474 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-631421a7-3120-43fd-b222-c2f28963fc94 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:09.046876 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-631421a7-3120-43fd-b222-c2f28963fc94 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:09.054840 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-631421a7-3120-43fd-b222-c2f28963fc94 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1267 microversion: 2.1 time: 0.148445 Jul 25 06:08:09.055404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 593/1162] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:08 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:09.275155 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-28c9a0e9-9ded-4966-87be-94a81676475a tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:09.275711 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-28c9a0e9-9ded-4966-87be-94a81676475a tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:09.282123 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28c9a0e9-9ded-4966-87be-94a81676475a tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:09.282589 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28c9a0e9-9ded-4966-87be-94a81676475a tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:09.283364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28c9a0e9-9ded-4966-87be-94a81676475a tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:09.284443 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-28c9a0e9-9ded-4966-87be-94a81676475a tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:09.424363 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-28c9a0e9-9ded-4966-87be-94a81676475a tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:09.432224 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-28c9a0e9-9ded-4966-87be-94a81676475a tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1755 microversion: 2.1 time: 0.160951 Jul 25 06:08:09.432800 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 570/1163] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:09 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:10.072011 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-94febdd9-a80a-40e1-9469-5b703fddf756 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:10.072625 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-94febdd9-a80a-40e1-9469-5b703fddf756 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:10.079031 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-94febdd9-a80a-40e1-9469-5b703fddf756 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:10.079477 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-94febdd9-a80a-40e1-9469-5b703fddf756 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:10.080242 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-94febdd9-a80a-40e1-9469-5b703fddf756 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:10.080697 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-94febdd9-a80a-40e1-9469-5b703fddf756 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:10.211939 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-94febdd9-a80a-40e1-9469-5b703fddf756 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:10.219306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-94febdd9-a80a-40e1-9469-5b703fddf756 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1267 microversion: 2.1 time: 0.151139 Jul 25 06:08:10.219874 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 594/1164] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:10 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:10.449189 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-52db90fb-7199-49e5-bb55-7f90a8c032a2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:10.449743 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-52db90fb-7199-49e5-bb55-7f90a8c032a2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:10.456146 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-52db90fb-7199-49e5-bb55-7f90a8c032a2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:10.456588 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-52db90fb-7199-49e5-bb55-7f90a8c032a2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:10.457331 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-52db90fb-7199-49e5-bb55-7f90a8c032a2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:10.457756 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-52db90fb-7199-49e5-bb55-7f90a8c032a2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:10.594929 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-52db90fb-7199-49e5-bb55-7f90a8c032a2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:10.603213 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-52db90fb-7199-49e5-bb55-7f90a8c032a2 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1755 microversion: 2.1 time: 0.157968 Jul 25 06:08:10.603775 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 571/1165] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:10 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:11.235908 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-72c49396-caba-4932-9a46-33b4397b1835 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:11.236449 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-72c49396-caba-4932-9a46-33b4397b1835 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:11.243484 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-72c49396-caba-4932-9a46-33b4397b1835 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:11.243929 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-72c49396-caba-4932-9a46-33b4397b1835 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:11.244686 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-72c49396-caba-4932-9a46-33b4397b1835 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:11.245117 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-72c49396-caba-4932-9a46-33b4397b1835 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:11.370928 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-72c49396-caba-4932-9a46-33b4397b1835 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:11.378133 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-72c49396-caba-4932-9a46-33b4397b1835 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1267 microversion: 2.1 time: 0.146109 Jul 25 06:08:11.378725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 595/1166] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:11 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:11.620501 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6cd1d31b-8b49-4621-805b-9548fb1f1138 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:11.621521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-6cd1d31b-8b49-4621-805b-9548fb1f1138 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:11.628251 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6cd1d31b-8b49-4621-805b-9548fb1f1138 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:11.628704 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6cd1d31b-8b49-4621-805b-9548fb1f1138 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:11.629467 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6cd1d31b-8b49-4621-805b-9548fb1f1138 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:11.629901 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6cd1d31b-8b49-4621-805b-9548fb1f1138 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:11.773259 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-6cd1d31b-8b49-4621-805b-9548fb1f1138 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:11.781432 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-6cd1d31b-8b49-4621-805b-9548fb1f1138 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1755 microversion: 2.1 time: 0.164746 Jul 25 06:08:11.781997 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 572/1167] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:11 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:12.394735 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d19d8e97-8c03-4fa7-a0cc-79b127a23317 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:12.395346 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d19d8e97-8c03-4fa7-a0cc-79b127a23317 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:12.401719 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d19d8e97-8c03-4fa7-a0cc-79b127a23317 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:12.402163 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d19d8e97-8c03-4fa7-a0cc-79b127a23317 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:12.402952 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d19d8e97-8c03-4fa7-a0cc-79b127a23317 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:12.403389 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d19d8e97-8c03-4fa7-a0cc-79b127a23317 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:12.531510 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d19d8e97-8c03-4fa7-a0cc-79b127a23317 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:12.539332 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d19d8e97-8c03-4fa7-a0cc-79b127a23317 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1267 microversion: 2.1 time: 0.148515 Jul 25 06:08:12.539898 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 596/1168] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:12 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:12.799098 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-ee7a8508-13f7-4faa-8310-0589e6751434 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:12.799624 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-ee7a8508-13f7-4faa-8310-0589e6751434 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:12.806003 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ee7a8508-13f7-4faa-8310-0589e6751434 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:12.806436 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ee7a8508-13f7-4faa-8310-0589e6751434 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:12.807219 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ee7a8508-13f7-4faa-8310-0589e6751434 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:12.807640 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-ee7a8508-13f7-4faa-8310-0589e6751434 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:12.836525 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=2 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:08:12.854298 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=6 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:08:12.948889 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-ee7a8508-13f7-4faa-8310-0589e6751434 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:12.957332 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-ee7a8508-13f7-4faa-8310-0589e6751434 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1755 microversion: 2.1 time: 0.162443 Jul 25 06:08:12.957889 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 573/1169] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:12 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:13.556225 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b0e2d3d9-c74a-4711-b982-9bdeb1453c1b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:13.556837 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b0e2d3d9-c74a-4711-b982-9bdeb1453c1b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:13.558785 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=2 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:08:13.564073 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b0e2d3d9-c74a-4711-b982-9bdeb1453c1b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:13.564452 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b0e2d3d9-c74a-4711-b982-9bdeb1453c1b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:13.565209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b0e2d3d9-c74a-4711-b982-9bdeb1453c1b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:13.565675 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b0e2d3d9-c74a-4711-b982-9bdeb1453c1b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:13.700419 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b0e2d3d9-c74a-4711-b982-9bdeb1453c1b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:13.708478 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b0e2d3d9-c74a-4711-b982-9bdeb1453c1b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1267 microversion: 2.1 time: 0.156076 Jul 25 06:08:13.709042 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 597/1170] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:13 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:13.974329 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-73e659ce-6114-47dd-9458-e52fd8d385d0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:13.975006 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-73e659ce-6114-47dd-9458-e52fd8d385d0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:13.981544 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-73e659ce-6114-47dd-9458-e52fd8d385d0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:13.981991 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-73e659ce-6114-47dd-9458-e52fd8d385d0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:13.982783 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-73e659ce-6114-47dd-9458-e52fd8d385d0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:13.983219 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-73e659ce-6114-47dd-9458-e52fd8d385d0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:14.133154 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-73e659ce-6114-47dd-9458-e52fd8d385d0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:14.141053 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-73e659ce-6114-47dd-9458-e52fd8d385d0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1755 microversion: 2.1 time: 0.170596 Jul 25 06:08:14.142305 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 574/1171] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:13 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:14.724434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b101ad98-abdf-4276-9369-1f50d71a1278 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:14.724960 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b101ad98-abdf-4276-9369-1f50d71a1278 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:14.731447 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b101ad98-abdf-4276-9369-1f50d71a1278 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:14.731888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b101ad98-abdf-4276-9369-1f50d71a1278 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:14.732679 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b101ad98-abdf-4276-9369-1f50d71a1278 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:14.733103 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b101ad98-abdf-4276-9369-1f50d71a1278 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:14.861679 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b101ad98-abdf-4276-9369-1f50d71a1278 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:14.869965 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b101ad98-abdf-4276-9369-1f50d71a1278 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1267 microversion: 2.1 time: 0.149561 Jul 25 06:08:14.870541 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 598/1172] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:14 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:15.157813 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1855be5b-61a8-4051-aff5-b2ad1f4c7c6d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:15.158431 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1855be5b-61a8-4051-aff5-b2ad1f4c7c6d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:15.165603 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1855be5b-61a8-4051-aff5-b2ad1f4c7c6d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:15.166052 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1855be5b-61a8-4051-aff5-b2ad1f4c7c6d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:15.166851 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1855be5b-61a8-4051-aff5-b2ad1f4c7c6d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:15.167327 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1855be5b-61a8-4051-aff5-b2ad1f4c7c6d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:15.310616 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-1855be5b-61a8-4051-aff5-b2ad1f4c7c6d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:15.318739 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1855be5b-61a8-4051-aff5-b2ad1f4c7c6d tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1755 microversion: 2.1 time: 0.164516 Jul 25 06:08:15.319306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 575/1173] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:15 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:15.887489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-308b121a-5592-4970-b58a-b2d3fb95187a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:15.893308 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-308b121a-5592-4970-b58a-b2d3fb95187a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:15.895003 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-308b121a-5592-4970-b58a-b2d3fb95187a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:15.895465 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-308b121a-5592-4970-b58a-b2d3fb95187a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:15.896248 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-308b121a-5592-4970-b58a-b2d3fb95187a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:15.896688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-308b121a-5592-4970-b58a-b2d3fb95187a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:16.036674 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-308b121a-5592-4970-b58a-b2d3fb95187a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:16.044181 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-308b121a-5592-4970-b58a-b2d3fb95187a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1267 microversion: 2.1 time: 0.160529 Jul 25 06:08:16.044768 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 599/1174] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:15 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:16.335817 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-78d6abb7-416e-4128-b538-738962c669bb tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:16.336421 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-78d6abb7-416e-4128-b538-738962c669bb tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:16.342870 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-78d6abb7-416e-4128-b538-738962c669bb tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:16.343307 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-78d6abb7-416e-4128-b538-738962c669bb tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:16.344106 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-78d6abb7-416e-4128-b538-738962c669bb tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:16.344530 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-78d6abb7-416e-4128-b538-738962c669bb tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:16.484932 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-78d6abb7-416e-4128-b538-738962c669bb tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:16.493530 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-78d6abb7-416e-4128-b538-738962c669bb tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1758 microversion: 2.1 time: 0.161602 Jul 25 06:08:16.494096 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 576/1175] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:16 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:17.061688 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f08a240f-5ad4-4fda-86ef-b9970a7f2819 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:17.062292 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f08a240f-5ad4-4fda-86ef-b9970a7f2819 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:17.069227 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f08a240f-5ad4-4fda-86ef-b9970a7f2819 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:17.069675 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f08a240f-5ad4-4fda-86ef-b9970a7f2819 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:17.070432 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f08a240f-5ad4-4fda-86ef-b9970a7f2819 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:17.070887 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f08a240f-5ad4-4fda-86ef-b9970a7f2819 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:17.203002 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-f08a240f-5ad4-4fda-86ef-b9970a7f2819 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:17.210382 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f08a240f-5ad4-4fda-86ef-b9970a7f2819 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1267 microversion: 2.1 time: 0.152547 Jul 25 06:08:17.210982 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 600/1176] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:17 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:18.110267 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-b69b27c3-480f-4616-895c-1ecc78ef4e39 req-af042b1e-dc6d-4f67-b6c9-14d7474150ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7934824b-229d-4bb6-a229-f071b9338837", "name": "network-vif-plugged", "status": "completed", "tag": "dad2140c-c348-4a04-8125-b587fa7f9d48"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:08:18.119552 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-b69b27c3-480f-4616-895c-1ecc78ef4e39 req-af042b1e-dc6d-4f67-b6c9-14d7474150ec service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:18.119998 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-b69b27c3-480f-4616-895c-1ecc78ef4e39 req-af042b1e-dc6d-4f67-b6c9-14d7474150ec service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:18.130524 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-b69b27c3-480f-4616-895c-1ecc78ef4e39 req-af042b1e-dc6d-4f67-b6c9-14d7474150ec service nova] Creating event network-vif-plugged:dad2140c-c348-4a04-8125-b587fa7f9d48 for instance 7934824b-229d-4bb6-a229-f071b9338837 on hv-cinder-85083 Jul 25 06:08:18.135529 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-b69b27c3-480f-4616-895c-1ecc78ef4e39 req-af042b1e-dc6d-4f67-b6c9-14d7474150ec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028957 Jul 25 06:08:18.136099 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 577/1177] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:08:18.226736 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d9b892e4-eeb7-4c3a-a0b8-8f69fc7a8686 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:18.227350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d9b892e4-eeb7-4c3a-a0b8-8f69fc7a8686 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:18.235424 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d9b892e4-eeb7-4c3a-a0b8-8f69fc7a8686 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:18.240391 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d9b892e4-eeb7-4c3a-a0b8-8f69fc7a8686 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:18.240391 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d9b892e4-eeb7-4c3a-a0b8-8f69fc7a8686 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:18.240391 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d9b892e4-eeb7-4c3a-a0b8-8f69fc7a8686 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:18.246161 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:08:18.373969 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d9b892e4-eeb7-4c3a-a0b8-8f69fc7a8686 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:18.382259 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d9b892e4-eeb7-4c3a-a0b8-8f69fc7a8686 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1267 microversion: 2.1 time: 0.159427 Jul 25 06:08:18.382852 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 601/1178] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:18 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:19.399843 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-befbd93d-4693-422a-83a5-6192c83447c7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:19.400563 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-befbd93d-4693-422a-83a5-6192c83447c7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:19.406863 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-befbd93d-4693-422a-83a5-6192c83447c7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:19.407309 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-befbd93d-4693-422a-83a5-6192c83447c7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:19.408051 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-befbd93d-4693-422a-83a5-6192c83447c7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:19.408475 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-befbd93d-4693-422a-83a5-6192c83447c7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:19.545150 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-befbd93d-4693-422a-83a5-6192c83447c7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:19.553376 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-befbd93d-4693-422a-83a5-6192c83447c7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1267 microversion: 2.1 time: 0.158251 Jul 25 06:08:19.553930 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 578/1179] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:19 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:20.570602 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d2541c2b-d281-4f3a-87e0-c07cf80a5f63 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:20.571220 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d2541c2b-d281-4f3a-87e0-c07cf80a5f63 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:20.577779 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d2541c2b-d281-4f3a-87e0-c07cf80a5f63 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:20.578226 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d2541c2b-d281-4f3a-87e0-c07cf80a5f63 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:20.579017 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d2541c2b-d281-4f3a-87e0-c07cf80a5f63 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:20.579451 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d2541c2b-d281-4f3a-87e0-c07cf80a5f63 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:20.706086 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d2541c2b-d281-4f3a-87e0-c07cf80a5f63 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:20.713550 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d2541c2b-d281-4f3a-87e0-c07cf80a5f63 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1455 microversion: 2.1 time: 0.146823 Jul 25 06:08:20.714120 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 602/1180] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:20 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1455 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:20.729841 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0a542eaf-f558-48e9-b4db-0aee6280d460 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:20.730459 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0a542eaf-f558-48e9-b4db-0aee6280d460 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:20.737041 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0a542eaf-f558-48e9-b4db-0aee6280d460 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:20.738118 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0a542eaf-f558-48e9-b4db-0aee6280d460 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:20.738834 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0a542eaf-f558-48e9-b4db-0aee6280d460 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:20.739276 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0a542eaf-f558-48e9-b4db-0aee6280d460 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:20.868602 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0a542eaf-f558-48e9-b4db-0aee6280d460 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:20.872106 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=100 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:08:20.876834 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0a542eaf-f558-48e9-b4db-0aee6280d460 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1455 microversion: 2.1 time: 0.150862 Jul 25 06:08:20.886187 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 579/1181] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:20 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:22.975582 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-334db64d-d4f4-4b80-bd0e-16b0499be50a req-97c715c1-0ad7-413c-b54a-cef5c7f153da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7934824b-229d-4bb6-a229-f071b9338837", "tag": "dad2140c-c348-4a04-8125-b587fa7f9d48"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:08:22.984038 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-334db64d-d4f4-4b80-bd0e-16b0499be50a req-97c715c1-0ad7-413c-b54a-cef5c7f153da service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:22.984553 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-334db64d-d4f4-4b80-bd0e-16b0499be50a req-97c715c1-0ad7-413c-b54a-cef5c7f153da service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:22.997576 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-334db64d-d4f4-4b80-bd0e-16b0499be50a req-97c715c1-0ad7-413c-b54a-cef5c7f153da service nova] Creating event network-changed:dad2140c-c348-4a04-8125-b587fa7f9d48 for instance 7934824b-229d-4bb6-a229-f071b9338837 on hv-cinder-85083 Jul 25 06:08:23.002888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-334db64d-d4f4-4b80-bd0e-16b0499be50a req-97c715c1-0ad7-413c-b54a-cef5c7f153da service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031513 Jul 25 06:08:23.003809 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 603/1182] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:08:49.422821 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-220ed6f4-6c62-4e10-9f42-eb4388b16819 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-590754252"}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:08:49.423420 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-220ed6f4-6c62-4e10-9f42-eb4388b16819 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:49.425646 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:08:49.430539 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-220ed6f4-6c62-4e10-9f42-eb4388b16819 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:49.430981 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-220ed6f4-6c62-4e10-9f42-eb4388b16819 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:49.431725 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-220ed6f4-6c62-4e10-9f42-eb4388b16819 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:49.432147 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-220ed6f4-6c62-4e10-9f42-eb4388b16819 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:49.606831 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.network.security_group_api [None req-220ed6f4-6c62-4e10-9f42-eb4388b16819 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Removing security group 37657994-5e2e-4af1-9043-0345eeb1913f from port d4f48ee1-da5f-427a-a821-05c06871ba9f Jul 25 06:08:50.007676 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-220ed6f4-6c62-4e10-9f42-eb4388b16819 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "POST /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2/action" status: 202 len: 0 microversion: 2.1 time: 0.588540 Jul 25 06:08:50.008479 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 580/1183] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 06:08:49 2022] POST /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:08:50.030059 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=42 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:08:50.030790 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=12 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:08:50.035119 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-22950edc-73bd-4fd4-b79c-36571289f5c8 req-58c872a6-7576-44ac-b8dc-0f24d400ddb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b8c81f-8362-4af8-97ce-73dab9c68cc2", "tag": "d4f48ee1-da5f-427a-a821-05c06871ba9f"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:08:50.050086 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-22950edc-73bd-4fd4-b79c-36571289f5c8 req-58c872a6-7576-44ac-b8dc-0f24d400ddb8 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:50.050380 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-22950edc-73bd-4fd4-b79c-36571289f5c8 req-58c872a6-7576-44ac-b8dc-0f24d400ddb8 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:50.078424 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-22950edc-73bd-4fd4-b79c-36571289f5c8 req-58c872a6-7576-44ac-b8dc-0f24d400ddb8 service nova] Creating event network-changed:d4f48ee1-da5f-427a-a821-05c06871ba9f for instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 on hv-cinder-85083 Jul 25 06:08:50.084253 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-22950edc-73bd-4fd4-b79c-36571289f5c8 req-58c872a6-7576-44ac-b8dc-0f24d400ddb8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058336 Jul 25 06:08:50.085739 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 604/1184] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:08:51.300142 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:08:51.300685 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Mon Jul 25 06:08:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:08:51.331962 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-576a3d49-a1d0-4d18-b913-457021f5544f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:51.332511 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-576a3d49-a1d0-4d18-b913-457021f5544f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:51.338524 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-576a3d49-a1d0-4d18-b913-457021f5544f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:51.338979 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-576a3d49-a1d0-4d18-b913-457021f5544f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:51.339738 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-576a3d49-a1d0-4d18-b913-457021f5544f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:51.340171 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-576a3d49-a1d0-4d18-b913-457021f5544f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:51.419333 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.objects.instance [None req-576a3d49-a1d0-4d18-b913-457021f5544f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lazy-loading 'services' on Instance uuid 14b8c81f-8362-4af8-97ce-73dab9c68cc2 {{(pid=130162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:08:51.574044 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-576a3d49-a1d0-4d18-b913-457021f5544f tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "DELETE /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2/os-volume_attachments/d512d9cf-8c4d-49d3-be43-8440c2275922" status: 202 len: 0 microversion: 2.1 time: 0.246282 Jul 25 06:08:51.574891 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 581/1185] 10.222.0.17 () {58 vars in 1415 bytes} [Mon Jul 25 06:08:51 2022] DELETE /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2/os-volume_attachments/d512d9cf-8c4d-49d3-be43-8440c2275922 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:08:51.585085 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-aa32e592-da08-41b8-b011-55e4dbd1e5cc tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:51.586361 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-aa32e592-da08-41b8-b011-55e4dbd1e5cc tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:51.593520 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aa32e592-da08-41b8-b011-55e4dbd1e5cc tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:51.593978 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aa32e592-da08-41b8-b011-55e4dbd1e5cc tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:51.594769 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aa32e592-da08-41b8-b011-55e4dbd1e5cc tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:51.595210 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-aa32e592-da08-41b8-b011-55e4dbd1e5cc tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:51.625251 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-aa32e592-da08-41b8-b011-55e4dbd1e5cc tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 Jul 25 06:08:51.625810 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 605/1186] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:08:51 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:08:52.099627 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-5230b5d0-8599-44f8-822d-81ecf024fe84 req-7dc4bc9d-d8cf-4e11-9522-8de4ab4516d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b8c81f-8362-4af8-97ce-73dab9c68cc2", "tag": "d4f48ee1-da5f-427a-a821-05c06871ba9f"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:08:52.108977 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-5230b5d0-8599-44f8-822d-81ecf024fe84 req-7dc4bc9d-d8cf-4e11-9522-8de4ab4516d4 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:52.109498 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-5230b5d0-8599-44f8-822d-81ecf024fe84 req-7dc4bc9d-d8cf-4e11-9522-8de4ab4516d4 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:52.121467 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-5230b5d0-8599-44f8-822d-81ecf024fe84 req-7dc4bc9d-d8cf-4e11-9522-8de4ab4516d4 service nova] Creating event network-changed:d4f48ee1-da5f-427a-a821-05c06871ba9f for instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 on hv-cinder-85083 Jul 25 06:08:52.127398 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-5230b5d0-8599-44f8-822d-81ecf024fe84 req-7dc4bc9d-d8cf-4e11-9522-8de4ab4516d4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031766 Jul 25 06:08:52.128228 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 582/1187] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:08:52.637879 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-06d30f5c-0fed-46b4-bd11-6f179e400787 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:52.638826 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-06d30f5c-0fed-46b4-bd11-6f179e400787 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:52.646516 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-06d30f5c-0fed-46b4-bd11-6f179e400787 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:52.646973 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-06d30f5c-0fed-46b4-bd11-6f179e400787 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:52.649456 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-06d30f5c-0fed-46b4-bd11-6f179e400787 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:52.649906 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-06d30f5c-0fed-46b4-bd11-6f179e400787 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:52.678059 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-06d30f5c-0fed-46b4-bd11-6f179e400787 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044229 Jul 25 06:08:52.678637 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 606/1188] 10.222.0.17 () {58 vars in 1301 bytes} [Mon Jul 25 06:08:52 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 06:08:52.690091 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-942b67d2-6d6f-4bba-a67d-d6a5c4e58b23 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:52.690703 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-942b67d2-6d6f-4bba-a67d-d6a5c4e58b23 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:52.697474 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-942b67d2-6d6f-4bba-a67d-d6a5c4e58b23 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:52.697943 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-942b67d2-6d6f-4bba-a67d-d6a5c4e58b23 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:52.698716 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-942b67d2-6d6f-4bba-a67d-d6a5c4e58b23 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:52.699197 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-942b67d2-6d6f-4bba-a67d-d6a5c4e58b23 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:52.772621 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-942b67d2-6d6f-4bba-a67d-d6a5c4e58b23 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] HTTP exception thrown: Instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 is not attached to volume d512d9cf-8c4d-49d3-be43-8440c2275922 Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-942b67d2-6d6f-4bba-a67d-d6a5c4e58b23 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Request method failure captured: Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: DELETE /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2/os-volume_attachments/d512d9cf-8c4d-49d3-be43-8440c2275922 HTTP/1.1 Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jLpyyRSWu4mH5pEXKjGq1NEGf8oF_VjL13D-wyYY2g-_OiOqjeiDWbS9B0HDqp8-D8rIto0mROtl5fvzOiWUOEOPJ7clQrXVnEfAXKPov6sdnSHFvCHcu5ym59nO3A6RnR_GPfZ7fBmcC5y7-0LvDL7UAEi3avDQ868g8C7itXeHyQ Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: a39f82493df2479395de88147e2f8292 Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-TestMinimumBasicScenario-1301586428 Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:08:52.777334 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:08:52.779117 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a39f82493df2479395de88147e2f8292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a39f82493df2479395de88147e2f8292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a39f82493df2479395de88147e2f8292"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a39f82493df2479395de88147e2f8292", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:08:52.779117 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-TestMinimumBasicScenario-1301586428 Jul 25 06:08:52.779117 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: a39f82493df2479395de88147e2f8292 Jul 25 06:08:52.779117 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1301586428 Jul 25 06:08:52.779117 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-TestMinimumBasicScenario-1301586428-project Jul 25 06:08:52.779117 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:08:52.779117 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:08:52.779117 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: a01a4b9868714295a1000e0a5a81143b Jul 25 06:08:52.779117 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-TestMinimumBasicScenario-1301586428-project Jul 25 06:08:52.779117 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:08:52.779117 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 is not attached to volume d512d9cf-8c4d-49d3-be43-8440c2275922 Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'server_id': '14b8c81f-8362-4af8-97ce-73dab9c68cc2', 'id': 'd512d9cf-8c4d-49d3-be43-8440c2275922'} Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d512d9cf-8c4d-49d3-be43-8440c2275922. Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:08:52.780074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:08:52.781692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:08:52.781692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 06:08:52.781692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 06:08:52.781692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 is not attached to volume d512d9cf-8c4d-49d3-be43-8440c2275922 Jul 25 06:08:52.781692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:08:52.781692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:08:52.781692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:08:52.781692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:08:52.781692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:08:52.781692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:08:52.781692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:08:52.781692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:08:52.781692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 is not attached to volume d512d9cf-8c4d-49d3-be43-8440c2275922 Jul 25 06:08:52.781692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:08:52.781692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-942b67d2-6d6f-4bba-a67d-d6a5c4e58b23 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Returning 404 to user: Instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 is not attached to volume d512d9cf-8c4d-49d3-be43-8440c2275922 {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:08:52.782964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-942b67d2-6d6f-4bba-a67d-d6a5c4e58b23 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "DELETE /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2/os-volume_attachments/d512d9cf-8c4d-49d3-be43-8440c2275922" status: 404 len: 154 microversion: 2.1 time: 0.091254 Jul 25 06:08:52.782964 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 583/1189] 10.222.0.17 () {58 vars in 1415 bytes} [Mon Jul 25 06:08:52 2022] DELETE /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2/os-volume_attachments/d512d9cf-8c4d-49d3-be43-8440c2275922 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:08:54.033055 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-f0cbdda4-a6af-4a24-9979-5eb8237502ba tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:54.034733 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f0cbdda4-a6af-4a24-9979-5eb8237502ba tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:54.040275 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f0cbdda4-a6af-4a24-9979-5eb8237502ba tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:54.040748 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f0cbdda4-a6af-4a24-9979-5eb8237502ba tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:54.041504 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f0cbdda4-a6af-4a24-9979-5eb8237502ba tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:54.041934 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-f0cbdda4-a6af-4a24-9979-5eb8237502ba tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:54.066550 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-f0cbdda4-a6af-4a24-9979-5eb8237502ba tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Going to try to terminate instance {{(pid=130163) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:08:54.300008 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-f0cbdda4-a6af-4a24-9979-5eb8237502ba tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "DELETE /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 204 len: 0 microversion: 2.1 time: 0.270400 Jul 25 06:08:54.300531 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 607/1190] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:08:54 2022] DELETE /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:08:54.309060 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e692efbb-2727-436b-be0c-ce121182fab0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:54.309753 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e692efbb-2727-436b-be0c-ce121182fab0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:54.316382 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e692efbb-2727-436b-be0c-ce121182fab0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:54.316822 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e692efbb-2727-436b-be0c-ce121182fab0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:54.317578 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e692efbb-2727-436b-be0c-ce121182fab0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:54.318011 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e692efbb-2727-436b-be0c-ce121182fab0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:54.444070 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-e692efbb-2727-436b-be0c-ce121182fab0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:54.455539 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e692efbb-2727-436b-be0c-ce121182fab0 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1553 microversion: 2.1 time: 0.150233 Jul 25 06:08:54.456111 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 584/1191] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:54 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:08:55.473881 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2df088d3-8f0a-4646-92f7-234075991f0b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:55.474616 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2df088d3-8f0a-4646-92f7-234075991f0b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:55.481016 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2df088d3-8f0a-4646-92f7-234075991f0b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:55.481461 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2df088d3-8f0a-4646-92f7-234075991f0b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:55.482216 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2df088d3-8f0a-4646-92f7-234075991f0b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:55.482681 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2df088d3-8f0a-4646-92f7-234075991f0b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:55.658184 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2df088d3-8f0a-4646-92f7-234075991f0b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:55.666228 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2df088d3-8f0a-4646-92f7-234075991f0b tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1553 microversion: 2.1 time: 0.196519 Jul 25 06:08:55.666814 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 608/1192] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:55 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1553 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:56.683676 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d1099989-fdbc-46f7-99fe-9961d53af9d9 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:56.684270 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d1099989-fdbc-46f7-99fe-9961d53af9d9 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:56.690820 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d1099989-fdbc-46f7-99fe-9961d53af9d9 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:56.691315 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d1099989-fdbc-46f7-99fe-9961d53af9d9 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:56.692073 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d1099989-fdbc-46f7-99fe-9961d53af9d9 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:56.692504 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d1099989-fdbc-46f7-99fe-9961d53af9d9 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:56.768208 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d1099989-fdbc-46f7-99fe-9961d53af9d9 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a4b9868714295a1000e0a5a81143b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39f82493df2479395de88147e2f8292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:56.777270 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d1099989-fdbc-46f7-99fe-9961d53af9d9 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 200 len: 1511 microversion: 2.1 time: 0.097441 Jul 25 06:08:56.787959 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 585/1193] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:56 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 1511 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:56.788941 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-f8d4f879-54e9-4b76-bddf-8b5433b26275 req-01d09206-5e06-4d1e-ae5f-72633b962601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b8c81f-8362-4af8-97ce-73dab9c68cc2", "name": "network-vif-deleted", "tag": "d4f48ee1-da5f-427a-a821-05c06871ba9f"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:08:56.796509 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-f8d4f879-54e9-4b76-bddf-8b5433b26275 req-01d09206-5e06-4d1e-ae5f-72633b962601 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:56.796954 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-f8d4f879-54e9-4b76-bddf-8b5433b26275 req-01d09206-5e06-4d1e-ae5f-72633b962601 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:56.808285 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-f8d4f879-54e9-4b76-bddf-8b5433b26275 req-01d09206-5e06-4d1e-ae5f-72633b962601 service nova] Creating event network-vif-deleted:d4f48ee1-da5f-427a-a821-05c06871ba9f for instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 on hv-cinder-85083 Jul 25 06:08:56.813018 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-f8d4f879-54e9-4b76-bddf-8b5433b26275 req-01d09206-5e06-4d1e-ae5f-72633b962601 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029443 Jul 25 06:08:56.816590 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 609/1194] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:08:57.706481 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:08:57.706689 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Mon Jul 25 06:08:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:08:57.803748 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e4fee159-9b0c-46dd-bed3-a7974a5a7168 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:57.804968 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-e4fee159-9b0c-46dd-bed3-a7974a5a7168 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] [instance: 14b8c81f-8362-4af8-97ce-73dab9c68cc2] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:57.811400 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e4fee159-9b0c-46dd-bed3-a7974a5a7168 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:57.811848 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e4fee159-9b0c-46dd-bed3-a7974a5a7168 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:57.812603 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e4fee159-9b0c-46dd-bed3-a7974a5a7168 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:57.813038 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-e4fee159-9b0c-46dd-bed3-a7974a5a7168 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:57.826061 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-e4fee159-9b0c-46dd-bed3-a7974a5a7168 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] HTTP exception thrown: Instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 could not be found. Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e4fee159-9b0c-46dd-bed3-a7974a5a7168 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Request method failure captured: Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 HTTP/1.1 Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jLpyyRSWu4mH5pEXKjGq1NEGf8oF_VjL13D-wyYY2g-_OiOqjeiDWbS9B0HDqp8-D8rIto0mROtl5fvzOiWUOEOPJ7clQrXVnEfAXKPov6sdnSHFvCHcu5ym59nO3A6RnR_GPfZ7fBmcC5y7-0LvDL7UAEi3avDQ868g8C7itXeHyQ Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: a39f82493df2479395de88147e2f8292 Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-TestMinimumBasicScenario-1301586428 Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:08:57.827598 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:08:57.829211 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a39f82493df2479395de88147e2f8292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a39f82493df2479395de88147e2f8292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a39f82493df2479395de88147e2f8292"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a39f82493df2479395de88147e2f8292", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:08:57.829211 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-TestMinimumBasicScenario-1301586428 Jul 25 06:08:57.829211 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: a39f82493df2479395de88147e2f8292 Jul 25 06:08:57.829211 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1301586428 Jul 25 06:08:57.829211 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-TestMinimumBasicScenario-1301586428-project Jul 25 06:08:57.829211 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:08:57.829211 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:08:57.829211 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: a01a4b9868714295a1000e0a5a81143b Jul 25 06:08:57.829211 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-TestMinimumBasicScenario-1301586428-project Jul 25 06:08:57.829211 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:08:57.829211 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 could not be found. Jul 25 06:08:57.829211 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '14b8c81f-8362-4af8-97ce-73dab9c68cc2'} Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 could not be found. Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:08:57.830191 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 could not be found. Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 could not be found. Jul 25 06:08:57.831924 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:08:57.833299 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-e4fee159-9b0c-46dd-bed3-a7974a5a7168 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Returning 404 to user: Instance 14b8c81f-8362-4af8-97ce-73dab9c68cc2 could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:08:57.833299 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-e4fee159-9b0c-46dd-bed3-a7974a5a7168 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2" status: 404 len: 111 microversion: 2.1 time: 0.029277 Jul 25 06:08:57.833299 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 586/1195] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:57 2022] GET /compute/v2.1/servers/14b8c81f-8362-4af8-97ce-73dab9c68cc2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:08:57.840533 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ecbe0650-869c-4ebb-9e9f-5cde8a8fb230 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] Calling method '.version_select at 0x7f9d35ff3e50>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:57.917899 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ecbe0650-869c-4ebb-9e9f-5cde8a8fb230 tempest-TestMinimumBasicScenario-1301586428 tempest-TestMinimumBasicScenario-1301586428-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1104445890" status: 202 len: 0 microversion: 2.1 time: 0.081936 Jul 25 06:08:57.918489 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 610/1196] 10.222.0.17 () {58 vars in 1271 bytes} [Mon Jul 25 06:08:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1104445890 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:10:18.177725 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=14 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:18.178485 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:18.182332 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3e3a69a3-ff8b-4209-b1ba-0d87c92b9e05 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:18.182868 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3e3a69a3-ff8b-4209-b1ba-0d87c92b9e05 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:18.188627 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3e3a69a3-ff8b-4209-b1ba-0d87c92b9e05 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:18.193107 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3e3a69a3-ff8b-4209-b1ba-0d87c92b9e05 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:18.193107 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3e3a69a3-ff8b-4209-b1ba-0d87c92b9e05 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:18.193107 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3e3a69a3-ff8b-4209-b1ba-0d87c92b9e05 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:18.214364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3e3a69a3-ff8b-4209-b1ba-0d87c92b9e05 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Going to try to terminate instance {{(pid=130162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:10:18.556182 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3e3a69a3-ff8b-4209-b1ba-0d87c92b9e05 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 204 len: 0 microversion: 2.1 time: 0.380040 Jul 25 06:10:18.556694 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 587/1197] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:10:18 2022] DELETE /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:10:18.562858 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:18.563666 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:18.567872 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3400b7a8-857f-4726-86f5-e7dd64397a73 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:18.568632 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-3400b7a8-857f-4726-86f5-e7dd64397a73 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:18.575246 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3400b7a8-857f-4726-86f5-e7dd64397a73 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:18.576200 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3400b7a8-857f-4726-86f5-e7dd64397a73 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:18.576960 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3400b7a8-857f-4726-86f5-e7dd64397a73 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:18.577402 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3400b7a8-857f-4726-86f5-e7dd64397a73 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:18.712282 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-3400b7a8-857f-4726-86f5-e7dd64397a73 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:18.720308 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-3400b7a8-857f-4726-86f5-e7dd64397a73 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1580 microversion: 2.1 time: 0.159401 Jul 25 06:10:18.720867 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 611/1198] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:18 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1580 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:19.738548 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-631061d4-0427-41b5-9d51-759094902bab tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:19.739286 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-631061d4-0427-41b5-9d51-759094902bab tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:19.745908 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-631061d4-0427-41b5-9d51-759094902bab tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:19.747602 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-631061d4-0427-41b5-9d51-759094902bab tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:19.747602 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-631061d4-0427-41b5-9d51-759094902bab tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:19.747602 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-631061d4-0427-41b5-9d51-759094902bab tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:19.878355 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-631061d4-0427-41b5-9d51-759094902bab tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:19.885734 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-631061d4-0427-41b5-9d51-759094902bab tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1580 microversion: 2.1 time: 0.151485 Jul 25 06:10:19.886295 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 588/1199] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:19 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1580 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:20.904513 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b2d91b86-e05b-4080-b529-0f70ce7f521b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:20.911673 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b2d91b86-e05b-4080-b529-0f70ce7f521b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:20.914122 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b2d91b86-e05b-4080-b529-0f70ce7f521b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:20.914499 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b2d91b86-e05b-4080-b529-0f70ce7f521b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:20.915498 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b2d91b86-e05b-4080-b529-0f70ce7f521b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:20.916025 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b2d91b86-e05b-4080-b529-0f70ce7f521b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:21.000531 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-df8ddfa5-3f0b-4444-9753-b28260bf55b8 req-59013259-b3b2-4ff0-aa91-ab6e783c6a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7934824b-229d-4bb6-a229-f071b9338837", "name": "network-vif-deleted", "tag": "dad2140c-c348-4a04-8125-b587fa7f9d48"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:10:21.001020 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b2d91b86-e05b-4080-b529-0f70ce7f521b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:21.009710 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b2d91b86-e05b-4080-b529-0f70ce7f521b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1512 microversion: 2.1 time: 0.109408 Jul 25 06:10:21.016007 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-df8ddfa5-3f0b-4444-9753-b28260bf55b8 req-59013259-b3b2-4ff0-aa91-ab6e783c6a1d service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:21.016328 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 612/1200] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:20 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1512 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:21.019364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-df8ddfa5-3f0b-4444-9753-b28260bf55b8 req-59013259-b3b2-4ff0-aa91-ab6e783c6a1d service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:21.032284 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-df8ddfa5-3f0b-4444-9753-b28260bf55b8 req-59013259-b3b2-4ff0-aa91-ab6e783c6a1d service nova] Creating event network-vif-deleted:dad2140c-c348-4a04-8125-b587fa7f9d48 for instance 7934824b-229d-4bb6-a229-f071b9338837 on hv-cinder-85083 Jul 25 06:10:21.037702 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-df8ddfa5-3f0b-4444-9753-b28260bf55b8 req-59013259-b3b2-4ff0-aa91-ab6e783c6a1d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040709 Jul 25 06:10:21.041421 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 589/1201] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:10:22.026647 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-a5d69257-c965-4e83-b5c2-7b66ae9e4ca8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:22.027261 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-a5d69257-c965-4e83-b5c2-7b66ae9e4ca8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:22.033925 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a5d69257-c965-4e83-b5c2-7b66ae9e4ca8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:22.034447 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a5d69257-c965-4e83-b5c2-7b66ae9e4ca8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:22.035605 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a5d69257-c965-4e83-b5c2-7b66ae9e4ca8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:22.036061 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a5d69257-c965-4e83-b5c2-7b66ae9e4ca8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:22.069040 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a5d69257-c965-4e83-b5c2-7b66ae9e4ca8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:22.069550 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-a5d69257-c965-4e83-b5c2-7b66ae9e4ca8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:22.069978 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.objects.instance [None req-a5d69257-c965-4e83-b5c2-7b66ae9e4ca8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lazy-loading 'fault' on Instance uuid 7934824b-229d-4bb6-a229-f071b9338837 {{(pid=130163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:10:22.112901 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-a5d69257-c965-4e83-b5c2-7b66ae9e4ca8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:22.120651 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-a5d69257-c965-4e83-b5c2-7b66ae9e4ca8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 200 len: 1231 microversion: 2.1 time: 0.098078 Jul 25 06:10:22.121322 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 613/1202] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:22 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:23.139116 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2a09ca77-53eb-44b8-bd73-2b395bd23d01 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:23.139866 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2a09ca77-53eb-44b8-bd73-2b395bd23d01 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:23.145976 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2a09ca77-53eb-44b8-bd73-2b395bd23d01 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:23.146419 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2a09ca77-53eb-44b8-bd73-2b395bd23d01 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:23.147198 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2a09ca77-53eb-44b8-bd73-2b395bd23d01 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:23.147646 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2a09ca77-53eb-44b8-bd73-2b395bd23d01 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:23.160391 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-2a09ca77-53eb-44b8-bd73-2b395bd23d01 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] HTTP exception thrown: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2a09ca77-53eb-44b8-bd73-2b395bd23d01 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Request method failure captured: Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 HTTP/1.1 Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jMpe7uIwLmg-YgfkJNhFTDfzN8JLVgbMV0lio3YmXOtTQ4ILmM1ZsfBjQR7_JTQRMScC8rfEfWzjxDH6R4vI7QiD4QwsSvFN5WWtxkHlyjOfSk0SOuEKTKZZVC8kIT1nPBjlAA54ha6aRm2LnqXVYV95FWHgiCfQePkvedjr-dI6M4 Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: 5eef98733468492383e255f9045cd025 Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-TestVolumeBootPattern-75221817 Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:10:23.161917 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:10:23.163628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5eef98733468492383e255f9045cd025"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5eef98733468492383e255f9045cd025"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5eef98733468492383e255f9045cd025"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5eef98733468492383e255f9045cd025", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:10:23.163628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-TestVolumeBootPattern-75221817 Jul 25 06:10:23.163628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: 5eef98733468492383e255f9045cd025 Jul 25 06:10:23.163628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-TestVolumeBootPattern-75221817 Jul 25 06:10:23.163628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-TestVolumeBootPattern-75221817-project Jul 25 06:10:23.163628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:10:23.163628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:10:23.163628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 8650e8e864f045c59cf38e7a50949b94 Jul 25 06:10:23.163628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-TestVolumeBootPattern-75221817-project Jul 25 06:10:23.163628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:10:23.163628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. Jul 25 06:10:23.163628 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '7934824b-229d-4bb6-a229-f071b9338837'} Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:10:23.164788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. Jul 25 06:10:23.166364 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:10:23.167782 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2a09ca77-53eb-44b8-bd73-2b395bd23d01 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Returning 404 to user: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:10:23.167782 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2a09ca77-53eb-44b8-bd73-2b395bd23d01 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 404 len: 111 microversion: 2.1 time: 0.028959 Jul 25 06:10:23.167782 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 590/1203] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:23 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:10:23.256979 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d2107161-b185-4e1d-bcb7-d87890fc2d37 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-767450297", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1541654995", "security_groups": [{"name": "tempest-secgroup-smoke-1531502122"}], "block_device_mapping_v2": [{"uuid": "9b338e5e-0e0a-43d6-82da-151e83506b02", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e18ffaf8-7ae8-4950-a6c2-4803be698590"}]}} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:10:23.366393 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.network.neutron [None req-d2107161-b185-4e1d-bcb7-d87890fc2d37 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] validate_networks() for [('e18ffaf8-7ae8-4950-a6c2-4803be698590', None, None, None, None, None)] {{(pid=130163) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:10:23.779911 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-d2107161-b185-4e1d-bcb7-d87890fc2d37 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Flavor limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:10:23.780329 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-d2107161-b185-4e1d-bcb7-d87890fc2d37 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Image limits 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:10:23.780799 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-d2107161-b185-4e1d-bcb7-d87890fc2d37 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Flavor pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:10:23.781205 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-d2107161-b185-4e1d-bcb7-d87890fc2d37 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Image pref 0:0:0 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:10:23.781613 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.virt.hardware [None req-d2107161-b185-4e1d-bcb7-d87890fc2d37 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:10:23.790392 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d2107161-b185-4e1d-bcb7-d87890fc2d37 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:23.790865 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d2107161-b185-4e1d-bcb7-d87890fc2d37 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:23.791656 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d2107161-b185-4e1d-bcb7-d87890fc2d37 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:23.792088 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d2107161-b185-4e1d-bcb7-d87890fc2d37 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:23.808462 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-d2107161-b185-4e1d-bcb7-d87890fc2d37 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Getting quotas for project 5eef98733468492383e255f9045cd025. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:10:23.812364 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.quota [None req-d2107161-b185-4e1d-bcb7-d87890fc2d37 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Getting quotas for user 8650e8e864f045c59cf38e7a50949b94 and project 5eef98733468492383e255f9045cd025. Resources: {'cores', 'ram', 'instances'} {{(pid=130163) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:10:23.868056 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d2107161-b185-4e1d-bcb7-d87890fc2d37 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Going to run 1 instances... {{(pid=130163) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:10:23.870152 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d2107161-b185-4e1d-bcb7-d87890fc2d37 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9b338e5e-0e0a-43d6-82da-151e83506b02',volume_size=None,volume_type=None)] {{(pid=130163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:10:24.251057 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d2107161-b185-4e1d-bcb7-d87890fc2d37 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.997765 Jul 25 06:10:24.254679 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 614/1204] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 06:10:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:10:24.261549 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-4b9abbd9-325c-40f1-a0ba-e4ae748dcec7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:24.262347 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-4b9abbd9-325c-40f1-a0ba-e4ae748dcec7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:24.317251 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4b9abbd9-325c-40f1-a0ba-e4ae748dcec7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:24.324781 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-4b9abbd9-325c-40f1-a0ba-e4ae748dcec7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1094 microversion: 2.1 time: 0.067002 Jul 25 06:10:24.325354 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 591/1205] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:24 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:25.343052 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-b2d3396a-f831-446c-b57b-6a0ea0240710 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:25.343605 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-b2d3396a-f831-446c-b57b-6a0ea0240710 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:25.350761 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b2d3396a-f831-446c-b57b-6a0ea0240710 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:25.351204 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b2d3396a-f831-446c-b57b-6a0ea0240710 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:25.351966 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b2d3396a-f831-446c-b57b-6a0ea0240710 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:25.352397 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-b2d3396a-f831-446c-b57b-6a0ea0240710 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:25.412364 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-b2d3396a-f831-446c-b57b-6a0ea0240710 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:25.424807 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-b2d3396a-f831-446c-b57b-6a0ea0240710 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1144 microversion: 2.1 time: 0.086658 Jul 25 06:10:25.425372 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 615/1206] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:25 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:26.441284 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a8a68767-bad2-4e88-8734-be03aeae2d62 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:26.444476 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a8a68767-bad2-4e88-8734-be03aeae2d62 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:26.450318 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a8a68767-bad2-4e88-8734-be03aeae2d62 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:26.451069 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a8a68767-bad2-4e88-8734-be03aeae2d62 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:26.452451 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a8a68767-bad2-4e88-8734-be03aeae2d62 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:26.453217 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a8a68767-bad2-4e88-8734-be03aeae2d62 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:26.523300 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-a8a68767-bad2-4e88-8734-be03aeae2d62 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:26.531989 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a8a68767-bad2-4e88-8734-be03aeae2d62 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1210 microversion: 2.1 time: 0.094471 Jul 25 06:10:26.532483 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 592/1207] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:26 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:27.549363 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-c5950d47-3490-4909-ae7d-c474d856164d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:27.549983 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-c5950d47-3490-4909-ae7d-c474d856164d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:27.556350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c5950d47-3490-4909-ae7d-c474d856164d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:27.556799 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c5950d47-3490-4909-ae7d-c474d856164d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:27.557556 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c5950d47-3490-4909-ae7d-c474d856164d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:27.558028 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-c5950d47-3490-4909-ae7d-c474d856164d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:27.779501 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-c5950d47-3490-4909-ae7d-c474d856164d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:27.786888 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-c5950d47-3490-4909-ae7d-c474d856164d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1278 microversion: 2.1 time: 0.241672 Jul 25 06:10:27.787459 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 616/1208] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:27 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1278 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:28.004379 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-e7faf2fd-c2bf-4d4c-bbc2-c1e0da12d984 req-c779e8e8-e19c-4ecf-89e0-f0ad4f343d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0522ba64-2fed-48a8-ae58-bc6e27070550", "tag": "4b6ff525-fca0-4b4b-84ff-4dd46b564360"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:10:28.014615 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-e7faf2fd-c2bf-4d4c-bbc2-c1e0da12d984 req-c779e8e8-e19c-4ecf-89e0-f0ad4f343d7a service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:28.019063 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-e7faf2fd-c2bf-4d4c-bbc2-c1e0da12d984 req-c779e8e8-e19c-4ecf-89e0-f0ad4f343d7a service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:28.036399 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-e7faf2fd-c2bf-4d4c-bbc2-c1e0da12d984 req-c779e8e8-e19c-4ecf-89e0-f0ad4f343d7a service nova] Creating event network-changed:4b6ff525-fca0-4b4b-84ff-4dd46b564360 for instance 0522ba64-2fed-48a8-ae58-bc6e27070550 on hv-cinder-85083 Jul 25 06:10:28.043708 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-e7faf2fd-c2bf-4d4c-bbc2-c1e0da12d984 req-c779e8e8-e19c-4ecf-89e0-f0ad4f343d7a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043904 Jul 25 06:10:28.045111 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 593/1209] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:10:28.804141 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-99ad74f2-9fba-4c4a-bed0-f6baa87b067a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:28.804755 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-99ad74f2-9fba-4c4a-bed0-f6baa87b067a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:28.811209 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-99ad74f2-9fba-4c4a-bed0-f6baa87b067a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:28.811649 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-99ad74f2-9fba-4c4a-bed0-f6baa87b067a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:28.812404 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-99ad74f2-9fba-4c4a-bed0-f6baa87b067a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:28.812862 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-99ad74f2-9fba-4c4a-bed0-f6baa87b067a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:28.944321 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-99ad74f2-9fba-4c4a-bed0-f6baa87b067a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:28.952490 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-99ad74f2-9fba-4c4a-bed0-f6baa87b067a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1266 microversion: 2.1 time: 0.152122 Jul 25 06:10:28.952984 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 617/1210] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:28 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:29.970884 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0258f920-710a-4098-97b7-55fa746441b3 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:29.971529 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0258f920-710a-4098-97b7-55fa746441b3 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:29.977823 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0258f920-710a-4098-97b7-55fa746441b3 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:29.978274 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0258f920-710a-4098-97b7-55fa746441b3 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:29.979076 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0258f920-710a-4098-97b7-55fa746441b3 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:29.979513 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0258f920-710a-4098-97b7-55fa746441b3 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:30.118112 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0258f920-710a-4098-97b7-55fa746441b3 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:30.125593 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0258f920-710a-4098-97b7-55fa746441b3 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1266 microversion: 2.1 time: 0.160175 Jul 25 06:10:30.126156 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 594/1211] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:29 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:31.142058 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5804a309-6bde-42e1-9615-77fbd35678e4 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:31.142691 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5804a309-6bde-42e1-9615-77fbd35678e4 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:31.149083 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5804a309-6bde-42e1-9615-77fbd35678e4 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:31.149524 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5804a309-6bde-42e1-9615-77fbd35678e4 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:31.150269 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5804a309-6bde-42e1-9615-77fbd35678e4 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:31.150727 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5804a309-6bde-42e1-9615-77fbd35678e4 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:31.295704 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5804a309-6bde-42e1-9615-77fbd35678e4 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:31.303313 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5804a309-6bde-42e1-9615-77fbd35678e4 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1266 microversion: 2.1 time: 0.165164 Jul 25 06:10:31.303871 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 618/1212] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:31 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:32.320522 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-846ca503-8505-4417-bc49-1215a1dd3971 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:32.321077 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-846ca503-8505-4417-bc49-1215a1dd3971 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:32.328379 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-846ca503-8505-4417-bc49-1215a1dd3971 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:32.328815 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-846ca503-8505-4417-bc49-1215a1dd3971 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:32.329559 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-846ca503-8505-4417-bc49-1215a1dd3971 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:32.329982 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-846ca503-8505-4417-bc49-1215a1dd3971 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:32.461901 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-846ca503-8505-4417-bc49-1215a1dd3971 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:32.469197 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-846ca503-8505-4417-bc49-1215a1dd3971 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1266 microversion: 2.1 time: 0.152574 Jul 25 06:10:32.469753 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 595/1213] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:32 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:33.485523 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-5b9a4c95-2b3d-4bb5-a510-f3a7536e952b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:33.486131 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-5b9a4c95-2b3d-4bb5-a510-f3a7536e952b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:33.492570 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5b9a4c95-2b3d-4bb5-a510-f3a7536e952b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:33.493011 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5b9a4c95-2b3d-4bb5-a510-f3a7536e952b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:33.493767 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5b9a4c95-2b3d-4bb5-a510-f3a7536e952b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:33.494196 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-5b9a4c95-2b3d-4bb5-a510-f3a7536e952b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:33.623705 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-5b9a4c95-2b3d-4bb5-a510-f3a7536e952b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:33.631117 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-5b9a4c95-2b3d-4bb5-a510-f3a7536e952b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1266 microversion: 2.1 time: 0.149440 Jul 25 06:10:33.631687 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 619/1214] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:33 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:34.648168 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-0c38705f-ca39-4026-85f4-f434a0a802cf tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:34.648777 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-0c38705f-ca39-4026-85f4-f434a0a802cf tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:34.651448 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=2 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:34.657504 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0c38705f-ca39-4026-85f4-f434a0a802cf tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:34.661709 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0c38705f-ca39-4026-85f4-f434a0a802cf tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:34.661709 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0c38705f-ca39-4026-85f4-f434a0a802cf tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:34.661709 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-0c38705f-ca39-4026-85f4-f434a0a802cf tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:34.793918 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-0c38705f-ca39-4026-85f4-f434a0a802cf tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:34.802271 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-0c38705f-ca39-4026-85f4-f434a0a802cf tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1266 microversion: 2.1 time: 0.158625 Jul 25 06:10:34.802852 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 596/1215] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:34 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:35.818884 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-d4bbfc61-abad-49bd-a0b5-09f7f8bb7e5a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:35.819475 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-d4bbfc61-abad-49bd-a0b5-09f7f8bb7e5a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:35.821276 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=2 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:35.821947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=6 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:35.827668 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d4bbfc61-abad-49bd-a0b5-09f7f8bb7e5a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:35.828110 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d4bbfc61-abad-49bd-a0b5-09f7f8bb7e5a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:35.828871 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d4bbfc61-abad-49bd-a0b5-09f7f8bb7e5a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:35.829306 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-d4bbfc61-abad-49bd-a0b5-09f7f8bb7e5a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:35.958555 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-d4bbfc61-abad-49bd-a0b5-09f7f8bb7e5a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:35.966533 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-d4bbfc61-abad-49bd-a0b5-09f7f8bb7e5a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1266 microversion: 2.1 time: 0.151049 Jul 25 06:10:35.967098 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 620/1216] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:35 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:36.986788 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-6b9c9811-60cd-45c6-9c60-8cffd0ef019c tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:36.987404 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-6b9c9811-60cd-45c6-9c60-8cffd0ef019c tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:36.993537 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6b9c9811-60cd-45c6-9c60-8cffd0ef019c tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:36.993985 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6b9c9811-60cd-45c6-9c60-8cffd0ef019c tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:36.994771 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6b9c9811-60cd-45c6-9c60-8cffd0ef019c tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:36.995218 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-6b9c9811-60cd-45c6-9c60-8cffd0ef019c tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:37.128479 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-6b9c9811-60cd-45c6-9c60-8cffd0ef019c tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:37.135998 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-6b9c9811-60cd-45c6-9c60-8cffd0ef019c tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1266 microversion: 2.1 time: 0.153133 Jul 25 06:10:37.136552 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 597/1217] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:36 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:38.153275 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-7e8ba0ee-61a6-488a-a1ad-00622c906cfe tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:38.154509 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-7e8ba0ee-61a6-488a-a1ad-00622c906cfe tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:38.160504 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7e8ba0ee-61a6-488a-a1ad-00622c906cfe tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:38.160950 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7e8ba0ee-61a6-488a-a1ad-00622c906cfe tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:38.161706 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7e8ba0ee-61a6-488a-a1ad-00622c906cfe tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:38.162142 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-7e8ba0ee-61a6-488a-a1ad-00622c906cfe tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:38.293488 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-7e8ba0ee-61a6-488a-a1ad-00622c906cfe tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:38.301108 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-7e8ba0ee-61a6-488a-a1ad-00622c906cfe tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1266 microversion: 2.1 time: 0.151856 Jul 25 06:10:38.301671 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 621/1218] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:38 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:39.109645 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [req-2189c55c-9877-4002-9900-de76a8f945b5 req-0571455f-3bed-431d-8a92-372c4076534b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0522ba64-2fed-48a8-ae58-bc6e27070550", "name": "network-vif-plugged", "status": "completed", "tag": "4b6ff525-fca0-4b4b-84ff-4dd46b564360"}]} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:10:39.122698 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-2189c55c-9877-4002-9900-de76a8f945b5 req-0571455f-3bed-431d-8a92-372c4076534b service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:39.122698 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [req-2189c55c-9877-4002-9900-de76a8f945b5 req-0571455f-3bed-431d-8a92-372c4076534b service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:39.131909 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.compute.server_external_events [req-2189c55c-9877-4002-9900-de76a8f945b5 req-0571455f-3bed-431d-8a92-372c4076534b service nova] Creating event network-vif-plugged:4b6ff525-fca0-4b4b-84ff-4dd46b564360 for instance 0522ba64-2fed-48a8-ae58-bc6e27070550 on hv-cinder-85083 Jul 25 06:10:39.137039 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [req-2189c55c-9877-4002-9900-de76a8f945b5 req-0571455f-3bed-431d-8a92-372c4076534b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149495 Jul 25 06:10:39.137647 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 598/1219] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:10:39.318507 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-06afd14e-cac8-42a1-9f1b-d64c9ac564d8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:39.319140 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-06afd14e-cac8-42a1-9f1b-d64c9ac564d8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:39.326258 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-06afd14e-cac8-42a1-9f1b-d64c9ac564d8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:39.326751 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-06afd14e-cac8-42a1-9f1b-d64c9ac564d8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:39.327527 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-06afd14e-cac8-42a1-9f1b-d64c9ac564d8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:39.328008 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-06afd14e-cac8-42a1-9f1b-d64c9ac564d8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:39.471671 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-06afd14e-cac8-42a1-9f1b-d64c9ac564d8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:39.479259 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-06afd14e-cac8-42a1-9f1b-d64c9ac564d8 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1266 microversion: 2.1 time: 0.164824 Jul 25 06:10:39.479917 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 622/1220] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:39 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:40.497962 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-34f1db26-adab-42e9-8dbf-cd275068b19b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:40.498783 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-34f1db26-adab-42e9-8dbf-cd275068b19b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:40.505047 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-34f1db26-adab-42e9-8dbf-cd275068b19b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:40.505432 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-34f1db26-adab-42e9-8dbf-cd275068b19b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:40.506184 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-34f1db26-adab-42e9-8dbf-cd275068b19b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:40.506652 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-34f1db26-adab-42e9-8dbf-cd275068b19b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:40.639129 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-34f1db26-adab-42e9-8dbf-cd275068b19b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:40.646462 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-34f1db26-adab-42e9-8dbf-cd275068b19b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1266 microversion: 2.1 time: 0.153402 Jul 25 06:10:40.647034 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 599/1221] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:40 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:41.663794 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-07fba6c1-7993-4572-bcde-11fad62fcd3b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:41.664406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-07fba6c1-7993-4572-bcde-11fad62fcd3b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:41.671398 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-07fba6c1-7993-4572-bcde-11fad62fcd3b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:41.671847 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-07fba6c1-7993-4572-bcde-11fad62fcd3b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:41.672868 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-07fba6c1-7993-4572-bcde-11fad62fcd3b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:41.673301 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-07fba6c1-7993-4572-bcde-11fad62fcd3b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:41.803712 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-07fba6c1-7993-4572-bcde-11fad62fcd3b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:41.811678 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-07fba6c1-7993-4572-bcde-11fad62fcd3b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1453 microversion: 2.1 time: 0.152035 Jul 25 06:10:41.812231 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 623/1222] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:41 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:41.827517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-744645f8-19c8-468c-84d3-b898fe98b258 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:41.828151 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-744645f8-19c8-468c-84d3-b898fe98b258 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:41.834787 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-744645f8-19c8-468c-84d3-b898fe98b258 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:41.835226 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-744645f8-19c8-468c-84d3-b898fe98b258 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:41.835975 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-744645f8-19c8-468c-84d3-b898fe98b258 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:41.836399 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-744645f8-19c8-468c-84d3-b898fe98b258 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:41.964303 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-744645f8-19c8-468c-84d3-b898fe98b258 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:41.972201 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-744645f8-19c8-468c-84d3-b898fe98b258 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1453 microversion: 2.1 time: 0.148525 Jul 25 06:10:41.972755 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 600/1223] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:41 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:10:42.541061 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:10:42.541273 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Mon Jul 25 06:10:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:10:43.960599 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-a43dd5cc-5a21-4f3e-9662-2af41cf6cd61 req-519ff678-01aa-44b1-abeb-a2a842a06b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0522ba64-2fed-48a8-ae58-bc6e27070550", "tag": "4b6ff525-fca0-4b4b-84ff-4dd46b564360"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:10:43.969147 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-a43dd5cc-5a21-4f3e-9662-2af41cf6cd61 req-519ff678-01aa-44b1-abeb-a2a842a06b5f service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:43.969600 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-a43dd5cc-5a21-4f3e-9662-2af41cf6cd61 req-519ff678-01aa-44b1-abeb-a2a842a06b5f service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:43.980349 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-a43dd5cc-5a21-4f3e-9662-2af41cf6cd61 req-519ff678-01aa-44b1-abeb-a2a842a06b5f service nova] Creating event network-changed:4b6ff525-fca0-4b4b-84ff-4dd46b564360 for instance 0522ba64-2fed-48a8-ae58-bc6e27070550 on hv-cinder-85083 Jul 25 06:10:43.986012 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-a43dd5cc-5a21-4f3e-9662-2af41cf6cd61 req-519ff678-01aa-44b1-abeb-a2a842a06b5f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089189 Jul 25 06:10:43.986623 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 624/1224] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:12:11.309428 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:12:11.310214 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Mon Jul 25 06:12:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:12:18.479620 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:18.480373 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:18.484298 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-8964958b-698f-442f-bcc4-c112b71ac4a7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1672412254", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1541654995", "security_groups": [{"name": "tempest-secgroup-smoke-1531502122"}], "block_device_mapping_v2": [{"uuid": "b1f90faa-238c-4d72-a837-1b4a0eacb5fe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e18ffaf8-7ae8-4950-a6c2-4803be698590"}]}} {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:12:18.603577 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.network.neutron [None req-8964958b-698f-442f-bcc4-c112b71ac4a7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] validate_networks() for [('e18ffaf8-7ae8-4950-a6c2-4803be698590', None, None, None, None, None)] {{(pid=130162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:12:18.983326 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-8964958b-698f-442f-bcc4-c112b71ac4a7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Flavor limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:12:18.983745 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-8964958b-698f-442f-bcc4-c112b71ac4a7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Image limits 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:12:18.984215 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-8964958b-698f-442f-bcc4-c112b71ac4a7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Flavor pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:12:18.987435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-8964958b-698f-442f-bcc4-c112b71ac4a7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Image pref 0:0:0 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:12:18.987435 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.virt.hardware [None req-8964958b-698f-442f-bcc4-c112b71ac4a7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:12:18.994491 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8964958b-698f-442f-bcc4-c112b71ac4a7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:18.994931 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8964958b-698f-442f-bcc4-c112b71ac4a7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:18.995714 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8964958b-698f-442f-bcc4-c112b71ac4a7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:18.996162 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-8964958b-698f-442f-bcc4-c112b71ac4a7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:19.012696 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-8964958b-698f-442f-bcc4-c112b71ac4a7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Getting quotas for project 5eef98733468492383e255f9045cd025. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:12:19.016567 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.quota [None req-8964958b-698f-442f-bcc4-c112b71ac4a7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Getting quotas for user 8650e8e864f045c59cf38e7a50949b94 and project 5eef98733468492383e255f9045cd025. Resources: {'cores', 'ram', 'instances'} {{(pid=130162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:12:19.071982 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8964958b-698f-442f-bcc4-c112b71ac4a7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Going to run 1 instances... {{(pid=130162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:12:19.074020 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-8964958b-698f-442f-bcc4-c112b71ac4a7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1f90faa-238c-4d72-a837-1b4a0eacb5fe',volume_size=None,volume_type=None)] {{(pid=130162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:12:19.437729 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-8964958b-698f-442f-bcc4-c112b71ac4a7 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.959846 Jul 25 06:12:19.438681 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 601/1225] 10.222.0.17 () {60 vars in 1146 bytes} [Mon Jul 25 06:12:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:12:19.447750 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:19.449855 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=78 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:19.452896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-ff3e570f-c033-4236-ad76-f392fcd01e35 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:19.454453 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-ff3e570f-c033-4236-ad76-f392fcd01e35 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:19.518465 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-ff3e570f-c033-4236-ad76-f392fcd01e35 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:19.529350 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-ff3e570f-c033-4236-ad76-f392fcd01e35 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1095 microversion: 2.1 time: 0.083932 Jul 25 06:12:19.529903 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 625/1226] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:19 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1095 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:20.546638 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a2850d72-90a4-4d58-ac0c-5173c1beff8a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:20.547246 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a2850d72-90a4-4d58-ac0c-5173c1beff8a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:20.554996 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a2850d72-90a4-4d58-ac0c-5173c1beff8a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:20.555477 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a2850d72-90a4-4d58-ac0c-5173c1beff8a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:20.556244 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a2850d72-90a4-4d58-ac0c-5173c1beff8a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:20.556674 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a2850d72-90a4-4d58-ac0c-5173c1beff8a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:20.618440 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-a2850d72-90a4-4d58-ac0c-5173c1beff8a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:20.625968 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a2850d72-90a4-4d58-ac0c-5173c1beff8a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1145 microversion: 2.1 time: 0.083321 Jul 25 06:12:20.626542 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 602/1227] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:20 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:21.642947 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-fa1f3fe4-81d7-4013-90fc-20677a6cf43b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:21.643561 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-fa1f3fe4-81d7-4013-90fc-20677a6cf43b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:21.651187 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fa1f3fe4-81d7-4013-90fc-20677a6cf43b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:21.651641 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fa1f3fe4-81d7-4013-90fc-20677a6cf43b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:21.652409 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fa1f3fe4-81d7-4013-90fc-20677a6cf43b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:21.652853 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-fa1f3fe4-81d7-4013-90fc-20677a6cf43b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:21.721265 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-fa1f3fe4-81d7-4013-90fc-20677a6cf43b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:21.729802 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-fa1f3fe4-81d7-4013-90fc-20677a6cf43b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1211 microversion: 2.1 time: 0.091447 Jul 25 06:12:21.730399 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 626/1228] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:21 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:22.748633 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-3fd40ea5-fd66-45d9-a215-ac430c55a97b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:22.749282 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-3fd40ea5-fd66-45d9-a215-ac430c55a97b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:22.756904 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3fd40ea5-fd66-45d9-a215-ac430c55a97b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:22.757388 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3fd40ea5-fd66-45d9-a215-ac430c55a97b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:22.758159 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3fd40ea5-fd66-45d9-a215-ac430c55a97b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:22.758623 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-3fd40ea5-fd66-45d9-a215-ac430c55a97b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:22.931616 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-3fd40ea5-fd66-45d9-a215-ac430c55a97b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:22.943728 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-3fd40ea5-fd66-45d9-a215-ac430c55a97b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1279 microversion: 2.1 time: 0.198977 Jul 25 06:12:22.945220 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 603/1229] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:22 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1279 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:23.245662 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-8a06d963-0cbb-4565-9f5d-92d2265f7490 req-efe96bbc-4520-4c20-9e64-8b1ca9e5624f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f3605b-9258-4ed6-8c32-e323e0c814bb", "tag": "bcd065b4-fdcd-4c0c-8b06-30a3bc6807ee"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:12:23.254421 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-8a06d963-0cbb-4565-9f5d-92d2265f7490 req-efe96bbc-4520-4c20-9e64-8b1ca9e5624f service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:23.255425 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-8a06d963-0cbb-4565-9f5d-92d2265f7490 req-efe96bbc-4520-4c20-9e64-8b1ca9e5624f service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:23.272018 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-8a06d963-0cbb-4565-9f5d-92d2265f7490 req-efe96bbc-4520-4c20-9e64-8b1ca9e5624f service nova] Creating event network-changed:bcd065b4-fdcd-4c0c-8b06-30a3bc6807ee for instance 80f3605b-9258-4ed6-8c32-e323e0c814bb on hv-cinder-85083 Jul 25 06:12:23.279298 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-8a06d963-0cbb-4565-9f5d-92d2265f7490 req-efe96bbc-4520-4c20-9e64-8b1ca9e5624f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119318 Jul 25 06:12:23.279895 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 627/1230] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:12:23.961780 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-636a7593-8e99-405c-a521-530238cbc638 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:23.962398 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-636a7593-8e99-405c-a521-530238cbc638 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:23.969007 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-636a7593-8e99-405c-a521-530238cbc638 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:23.969456 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-636a7593-8e99-405c-a521-530238cbc638 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:23.970256 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-636a7593-8e99-405c-a521-530238cbc638 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:23.970729 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-636a7593-8e99-405c-a521-530238cbc638 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:24.106951 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-636a7593-8e99-405c-a521-530238cbc638 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:24.115089 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-636a7593-8e99-405c-a521-530238cbc638 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1267 microversion: 2.1 time: 0.157141 Jul 25 06:12:24.115662 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 604/1231] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:23 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:25.132915 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-9ca68f9b-2612-4918-a83c-6de4d20d74e2 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:25.133615 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-9ca68f9b-2612-4918-a83c-6de4d20d74e2 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:25.139737 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9ca68f9b-2612-4918-a83c-6de4d20d74e2 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:25.140182 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9ca68f9b-2612-4918-a83c-6de4d20d74e2 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:25.140945 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9ca68f9b-2612-4918-a83c-6de4d20d74e2 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:25.141377 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-9ca68f9b-2612-4918-a83c-6de4d20d74e2 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:25.276873 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-9ca68f9b-2612-4918-a83c-6de4d20d74e2 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:25.289316 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-9ca68f9b-2612-4918-a83c-6de4d20d74e2 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1267 microversion: 2.1 time: 0.161555 Jul 25 06:12:25.289881 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 628/1232] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:25 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:26.306507 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-89b6f2e4-afdc-459c-93b2-3d0d607e840b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:26.307122 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-89b6f2e4-afdc-459c-93b2-3d0d607e840b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:26.313517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-89b6f2e4-afdc-459c-93b2-3d0d607e840b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:26.313965 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-89b6f2e4-afdc-459c-93b2-3d0d607e840b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:26.314755 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-89b6f2e4-afdc-459c-93b2-3d0d607e840b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:26.315200 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-89b6f2e4-afdc-459c-93b2-3d0d607e840b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:26.445132 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-89b6f2e4-afdc-459c-93b2-3d0d607e840b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:26.452585 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-89b6f2e4-afdc-459c-93b2-3d0d607e840b tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1267 microversion: 2.1 time: 0.150531 Jul 25 06:12:26.453147 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 605/1233] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:26 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:27.469715 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-07d322ce-b441-4a05-a8e7-a556ba72e6e3 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:27.470326 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-07d322ce-b441-4a05-a8e7-a556ba72e6e3 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:27.477969 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-07d322ce-b441-4a05-a8e7-a556ba72e6e3 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:27.478435 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-07d322ce-b441-4a05-a8e7-a556ba72e6e3 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:27.479194 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-07d322ce-b441-4a05-a8e7-a556ba72e6e3 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:27.479623 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-07d322ce-b441-4a05-a8e7-a556ba72e6e3 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:27.614670 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-07d322ce-b441-4a05-a8e7-a556ba72e6e3 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:27.625097 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-07d322ce-b441-4a05-a8e7-a556ba72e6e3 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1267 microversion: 2.1 time: 0.159096 Jul 25 06:12:27.625700 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 629/1234] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:27 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:28.641900 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-fab2bdd8-dc66-4229-b15c-70a0e8de9e0e tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:28.642529 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-fab2bdd8-dc66-4229-b15c-70a0e8de9e0e tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:28.649523 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fab2bdd8-dc66-4229-b15c-70a0e8de9e0e tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:28.649970 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fab2bdd8-dc66-4229-b15c-70a0e8de9e0e tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:28.650747 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fab2bdd8-dc66-4229-b15c-70a0e8de9e0e tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:28.651187 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-fab2bdd8-dc66-4229-b15c-70a0e8de9e0e tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:28.782759 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-fab2bdd8-dc66-4229-b15c-70a0e8de9e0e tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:28.790825 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-fab2bdd8-dc66-4229-b15c-70a0e8de9e0e tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1267 microversion: 2.1 time: 0.152816 Jul 25 06:12:28.791387 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 606/1235] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:28 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:29.807170 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-01bcd981-b864-4a52-9652-055a0a27fe6d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:29.807835 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-01bcd981-b864-4a52-9652-055a0a27fe6d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:29.810320 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell0:SELECT=2 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:29.815267 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-01bcd981-b864-4a52-9652-055a0a27fe6d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:29.815740 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-01bcd981-b864-4a52-9652-055a0a27fe6d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:29.816502 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-01bcd981-b864-4a52-9652-055a0a27fe6d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:29.816929 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-01bcd981-b864-4a52-9652-055a0a27fe6d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:29.957264 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-01bcd981-b864-4a52-9652-055a0a27fe6d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:29.965812 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-01bcd981-b864-4a52-9652-055a0a27fe6d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1267 microversion: 2.1 time: 0.162468 Jul 25 06:12:29.968495 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 630/1236] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:29 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:30.982623 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-9dbec130-e6b3-49a3-b775-85ba6c2c46fc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:30.983176 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-9dbec130-e6b3-49a3-b775-85ba6c2c46fc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:30.984956 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=2 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:30.985608 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell0:SELECT=6 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:30.991579 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9dbec130-e6b3-49a3-b775-85ba6c2c46fc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:30.992025 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9dbec130-e6b3-49a3-b775-85ba6c2c46fc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:30.992786 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9dbec130-e6b3-49a3-b775-85ba6c2c46fc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:30.993216 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-9dbec130-e6b3-49a3-b775-85ba6c2c46fc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:31.127185 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-9dbec130-e6b3-49a3-b775-85ba6c2c46fc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:31.135252 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-9dbec130-e6b3-49a3-b775-85ba6c2c46fc tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1267 microversion: 2.1 time: 0.156629 Jul 25 06:12:31.135815 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 607/1237] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:30 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:32.152503 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-35743501-a653-43b3-9566-92a5736330e0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:32.153106 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-35743501-a653-43b3-9566-92a5736330e0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:32.159759 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-35743501-a653-43b3-9566-92a5736330e0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:32.160143 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-35743501-a653-43b3-9566-92a5736330e0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:32.160960 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-35743501-a653-43b3-9566-92a5736330e0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:32.161392 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-35743501-a653-43b3-9566-92a5736330e0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:32.291768 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-35743501-a653-43b3-9566-92a5736330e0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:32.299847 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-35743501-a653-43b3-9566-92a5736330e0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1267 microversion: 2.1 time: 0.151135 Jul 25 06:12:32.300432 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 631/1238] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:32 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:33.316166 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a42af04a-8fb7-4131-89db-2b4ffb036eaf tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:33.316785 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a42af04a-8fb7-4131-89db-2b4ffb036eaf tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:33.323351 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a42af04a-8fb7-4131-89db-2b4ffb036eaf tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:33.323801 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a42af04a-8fb7-4131-89db-2b4ffb036eaf tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:33.324566 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a42af04a-8fb7-4131-89db-2b4ffb036eaf tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:33.325005 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a42af04a-8fb7-4131-89db-2b4ffb036eaf tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:33.474847 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-a42af04a-8fb7-4131-89db-2b4ffb036eaf tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:33.482507 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a42af04a-8fb7-4131-89db-2b4ffb036eaf tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1267 microversion: 2.1 time: 0.170235 Jul 25 06:12:33.483263 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 608/1239] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:33 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:33.591068 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-684a9cd6-be29-409f-a7f3-8f487347ac1f req-8cd28466-bb1d-4585-9aeb-b3e35231cf4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f3605b-9258-4ed6-8c32-e323e0c814bb", "name": "network-vif-plugged", "status": "completed", "tag": "bcd065b4-fdcd-4c0c-8b06-30a3bc6807ee"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:12:33.608204 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-684a9cd6-be29-409f-a7f3-8f487347ac1f req-8cd28466-bb1d-4585-9aeb-b3e35231cf4d service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:33.608645 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-684a9cd6-be29-409f-a7f3-8f487347ac1f req-8cd28466-bb1d-4585-9aeb-b3e35231cf4d service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:33.622192 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-684a9cd6-be29-409f-a7f3-8f487347ac1f req-8cd28466-bb1d-4585-9aeb-b3e35231cf4d service nova] Creating event network-vif-plugged:bcd065b4-fdcd-4c0c-8b06-30a3bc6807ee for instance 80f3605b-9258-4ed6-8c32-e323e0c814bb on hv-cinder-85083 Jul 25 06:12:33.627667 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-684a9cd6-be29-409f-a7f3-8f487347ac1f req-8cd28466-bb1d-4585-9aeb-b3e35231cf4d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040591 Jul 25 06:12:33.628253 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 632/1240] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:12:34.500081 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-88f6e9d2-f044-4ba9-993c-8acadf452095 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:34.500827 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-88f6e9d2-f044-4ba9-993c-8acadf452095 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:34.508178 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-88f6e9d2-f044-4ba9-993c-8acadf452095 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:34.508631 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-88f6e9d2-f044-4ba9-993c-8acadf452095 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:34.509422 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-88f6e9d2-f044-4ba9-993c-8acadf452095 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:34.509865 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-88f6e9d2-f044-4ba9-993c-8acadf452095 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:34.645744 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-88f6e9d2-f044-4ba9-993c-8acadf452095 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:34.653723 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-88f6e9d2-f044-4ba9-993c-8acadf452095 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1267 microversion: 2.1 time: 0.157592 Jul 25 06:12:34.654291 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 609/1241] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:34 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:35.675952 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2edaf458-463f-45cb-a70e-0688dd5c6f3a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:35.677181 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2edaf458-463f-45cb-a70e-0688dd5c6f3a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:35.684153 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2edaf458-463f-45cb-a70e-0688dd5c6f3a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:35.684602 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2edaf458-463f-45cb-a70e-0688dd5c6f3a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:35.685353 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2edaf458-463f-45cb-a70e-0688dd5c6f3a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:35.685786 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2edaf458-463f-45cb-a70e-0688dd5c6f3a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:35.822212 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2edaf458-463f-45cb-a70e-0688dd5c6f3a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:35.829827 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2edaf458-463f-45cb-a70e-0688dd5c6f3a tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1455 microversion: 2.1 time: 0.161418 Jul 25 06:12:35.830423 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 633/1242] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:35 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:35.846420 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-aa231f1e-4570-4203-93cf-098c24486db0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:35.847064 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-aa231f1e-4570-4203-93cf-098c24486db0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:35.853568 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aa231f1e-4570-4203-93cf-098c24486db0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:35.854015 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aa231f1e-4570-4203-93cf-098c24486db0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:35.854803 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aa231f1e-4570-4203-93cf-098c24486db0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:35.855238 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aa231f1e-4570-4203-93cf-098c24486db0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:35.989494 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-aa231f1e-4570-4203-93cf-098c24486db0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:35.997484 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-aa231f1e-4570-4203-93cf-098c24486db0 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1455 microversion: 2.1 time: 0.154894 Jul 25 06:12:36.002692 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 610/1243] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:35 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:12:38.238957 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-06731b79-b88c-4eba-bc6e-0b5ae23c4b3e req-34a30ebe-9e74-4399-9386-0296febdc18d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f3605b-9258-4ed6-8c32-e323e0c814bb", "tag": "bcd065b4-fdcd-4c0c-8b06-30a3bc6807ee"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:12:38.247131 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-06731b79-b88c-4eba-bc6e-0b5ae23c4b3e req-34a30ebe-9e74-4399-9386-0296febdc18d service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:38.247574 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-06731b79-b88c-4eba-bc6e-0b5ae23c4b3e req-34a30ebe-9e74-4399-9386-0296febdc18d service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:38.260140 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-06731b79-b88c-4eba-bc6e-0b5ae23c4b3e req-34a30ebe-9e74-4399-9386-0296febdc18d service nova] Creating event network-changed:bcd065b4-fdcd-4c0c-8b06-30a3bc6807ee for instance 80f3605b-9258-4ed6-8c32-e323e0c814bb on hv-cinder-85083 Jul 25 06:12:38.265795 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-06731b79-b88c-4eba-bc6e-0b5ae23c4b3e req-34a30ebe-9e74-4399-9386-0296febdc18d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030489 Jul 25 06:12:38.266817 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 634/1244] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:14:02.549306 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:14:02.550156 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Mon Jul 25 06:14:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:14:20.975485 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:14:20.975485 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG dbcounter [-] [130162] Writing DB stats nova_cell1:SELECT=56 {{(pid=130162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:14:20.976566 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_api:SELECT=22 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:14:20.978235 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG dbcounter [-] [130163] Writing DB stats nova_cell1:SELECT=42 {{(pid=130163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:14:20.978581 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-692e4609-39da-462b-a72f-509260b04ae6 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:20.979074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-692e4609-39da-462b-a72f-509260b04ae6 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:20.983309 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-611b8edb-cc32-476c-81eb-9866f1796afd req-3aadae0b-1e30-40b7-b871-b4906be5d7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f3605b-9258-4ed6-8c32-e323e0c814bb", "tag": "bcd065b4-fdcd-4c0c-8b06-30a3bc6807ee"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:14:20.989644 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-692e4609-39da-462b-a72f-509260b04ae6 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:20.990088 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-692e4609-39da-462b-a72f-509260b04ae6 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:20.990879 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-692e4609-39da-462b-a72f-509260b04ae6 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:20.991310 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-692e4609-39da-462b-a72f-509260b04ae6 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:20.992595 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-611b8edb-cc32-476c-81eb-9866f1796afd req-3aadae0b-1e30-40b7-b871-b4906be5d7d4 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:20.993107 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-611b8edb-cc32-476c-81eb-9866f1796afd req-3aadae0b-1e30-40b7-b871-b4906be5d7d4 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:21.005752 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-611b8edb-cc32-476c-81eb-9866f1796afd req-3aadae0b-1e30-40b7-b871-b4906be5d7d4 service nova] Creating event network-changed:bcd065b4-fdcd-4c0c-8b06-30a3bc6807ee for instance 80f3605b-9258-4ed6-8c32-e323e0c814bb on hv-cinder-85083 Jul 25 06:14:21.011253 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-611b8edb-cc32-476c-81eb-9866f1796afd req-3aadae0b-1e30-40b7-b871-b4906be5d7d4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037566 Jul 25 06:14:21.012434 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 635/1245] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:14:21.032058 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-692e4609-39da-462b-a72f-509260b04ae6 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Going to try to terminate instance {{(pid=130162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:14:21.446916 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-692e4609-39da-462b-a72f-509260b04ae6 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "DELETE /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 204 len: 0 microversion: 2.1 time: 0.475521 Jul 25 06:14:21.448040 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 611/1246] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:14:20 2022] DELETE /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:14:21.461511 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-00fdd40d-5bb6-4cde-8898-8e0d8ec8772d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:21.462767 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-00fdd40d-5bb6-4cde-8898-8e0d8ec8772d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:21.472628 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-00fdd40d-5bb6-4cde-8898-8e0d8ec8772d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:21.473352 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-00fdd40d-5bb6-4cde-8898-8e0d8ec8772d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:21.474362 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-00fdd40d-5bb6-4cde-8898-8e0d8ec8772d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:21.475141 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-00fdd40d-5bb6-4cde-8898-8e0d8ec8772d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:21.676875 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-00fdd40d-5bb6-4cde-8898-8e0d8ec8772d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:14:21.684628 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-00fdd40d-5bb6-4cde-8898-8e0d8ec8772d tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1580 microversion: 2.1 time: 0.231881 Jul 25 06:14:21.685195 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 636/1247] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:14:21 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1580 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:14:22.702149 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-aab6c753-c721-42f4-b48f-c84741179ce4 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:22.702886 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-aab6c753-c721-42f4-b48f-c84741179ce4 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:22.709415 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aab6c753-c721-42f4-b48f-c84741179ce4 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:22.709863 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aab6c753-c721-42f4-b48f-c84741179ce4 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:22.710647 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aab6c753-c721-42f4-b48f-c84741179ce4 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:22.711083 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-aab6c753-c721-42f4-b48f-c84741179ce4 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:22.903392 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-aab6c753-c721-42f4-b48f-c84741179ce4 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:14:22.911533 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-aab6c753-c721-42f4-b48f-c84741179ce4 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1461 microversion: 2.1 time: 0.213561 Jul 25 06:14:22.921174 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 612/1248] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:14:22 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1461 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:14:23.401401 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-f27bf4ea-9dfc-4dc1-8a59-ece1416bc8e1 req-19dddef7-81f1-41aa-9da9-39b0544036d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f3605b-9258-4ed6-8c32-e323e0c814bb", "name": "network-vif-deleted", "tag": "bcd065b4-fdcd-4c0c-8b06-30a3bc6807ee"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:14:23.410270 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-f27bf4ea-9dfc-4dc1-8a59-ece1416bc8e1 req-19dddef7-81f1-41aa-9da9-39b0544036d3 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:23.410926 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-f27bf4ea-9dfc-4dc1-8a59-ece1416bc8e1 req-19dddef7-81f1-41aa-9da9-39b0544036d3 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:23.422080 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-f27bf4ea-9dfc-4dc1-8a59-ece1416bc8e1 req-19dddef7-81f1-41aa-9da9-39b0544036d3 service nova] Creating event network-vif-deleted:bcd065b4-fdcd-4c0c-8b06-30a3bc6807ee for instance 80f3605b-9258-4ed6-8c32-e323e0c814bb on hv-cinder-85083 Jul 25 06:14:23.427599 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-f27bf4ea-9dfc-4dc1-8a59-ece1416bc8e1 req-19dddef7-81f1-41aa-9da9-39b0544036d3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029573 Jul 25 06:14:23.428422 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 637/1249] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:14:23.929781 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-2a0b9b21-9d84-40d6-85b2-dbce982dc803 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:23.929781 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-2a0b9b21-9d84-40d6-85b2-dbce982dc803 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:23.936069 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2a0b9b21-9d84-40d6-85b2-dbce982dc803 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:23.936513 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2a0b9b21-9d84-40d6-85b2-dbce982dc803 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:23.937268 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2a0b9b21-9d84-40d6-85b2-dbce982dc803 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:23.937734 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-2a0b9b21-9d84-40d6-85b2-dbce982dc803 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:24.005622 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-2a0b9b21-9d84-40d6-85b2-dbce982dc803 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:14:24.013705 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-2a0b9b21-9d84-40d6-85b2-dbce982dc803 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 200 len: 1226 microversion: 2.1 time: 0.088980 Jul 25 06:14:24.014491 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 613/1250] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:14:23 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:14:25.032124 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3f49fa8e-fb27-447e-9a45-1e3f9cd3b667 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:25.032822 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-3f49fa8e-fb27-447e-9a45-1e3f9cd3b667 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 80f3605b-9258-4ed6-8c32-e323e0c814bb] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:25.039667 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3f49fa8e-fb27-447e-9a45-1e3f9cd3b667 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:25.040121 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3f49fa8e-fb27-447e-9a45-1e3f9cd3b667 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:25.040896 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3f49fa8e-fb27-447e-9a45-1e3f9cd3b667 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:25.041335 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3f49fa8e-fb27-447e-9a45-1e3f9cd3b667 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:25.055487 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-3f49fa8e-fb27-447e-9a45-1e3f9cd3b667 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] HTTP exception thrown: Instance 80f3605b-9258-4ed6-8c32-e323e0c814bb could not be found. Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3f49fa8e-fb27-447e-9a45-1e3f9cd3b667 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Request method failure captured: Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb HTTP/1.1 Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jMpe7uIwLmg-YgfkJNhFTDfzN8JLVgbMV0lio3YmXOtTQ4ILmM1ZsfBjQR7_JTQRMScC8rfEfWzjxDH6R4vI7QiD4QwsSvFN5WWtxkHlyjOfSk0SOuEKTKZZVC8kIT1nPBjlAA54ha6aRm2LnqXVYV95FWHgiCfQePkvedjr-dI6M4 Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 5eef98733468492383e255f9045cd025 Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-TestVolumeBootPattern-75221817 Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:14:25.057157 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:14:25.058800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5eef98733468492383e255f9045cd025"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5eef98733468492383e255f9045cd025"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5eef98733468492383e255f9045cd025"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5eef98733468492383e255f9045cd025", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:14:25.058800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-TestVolumeBootPattern-75221817 Jul 25 06:14:25.058800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 5eef98733468492383e255f9045cd025 Jul 25 06:14:25.058800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-TestVolumeBootPattern-75221817 Jul 25 06:14:25.058800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-TestVolumeBootPattern-75221817-project Jul 25 06:14:25.058800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:14:25.058800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:14:25.058800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 8650e8e864f045c59cf38e7a50949b94 Jul 25 06:14:25.058800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-TestVolumeBootPattern-75221817-project Jul 25 06:14:25.058800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:14:25.058800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 80f3605b-9258-4ed6-8c32-e323e0c814bb could not be found. Jul 25 06:14:25.058800 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '80f3605b-9258-4ed6-8c32-e323e0c814bb'} Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f3605b-9258-4ed6-8c32-e323e0c814bb could not be found. Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:14:25.059725 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f3605b-9258-4ed6-8c32-e323e0c814bb could not be found. Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f3605b-9258-4ed6-8c32-e323e0c814bb could not be found. Jul 25 06:14:25.061272 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:14:25.063281 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3f49fa8e-fb27-447e-9a45-1e3f9cd3b667 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Returning 404 to user: Instance 80f3605b-9258-4ed6-8c32-e323e0c814bb could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:14:25.063281 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-3f49fa8e-fb27-447e-9a45-1e3f9cd3b667 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb" status: 404 len: 111 microversion: 2.1 time: 0.031154 Jul 25 06:14:25.063281 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 638/1251] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:14:25 2022] GET /compute/v2.1/servers/80f3605b-9258-4ed6-8c32-e323e0c814bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:14:28.423070 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-1717b111-888b-4435-9161-0a4a6009640f tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:28.423579 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1717b111-888b-4435-9161-0a4a6009640f tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:28.426016 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-91b5d937-ba9f-4fb4-a650-2bf3fd808447 req-d576a18b-88d0-4156-b295-1ad38d63e5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0522ba64-2fed-48a8-ae58-bc6e27070550", "tag": "4b6ff525-fca0-4b4b-84ff-4dd46b564360"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:14:28.430235 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1717b111-888b-4435-9161-0a4a6009640f tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:28.430716 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1717b111-888b-4435-9161-0a4a6009640f tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:28.431554 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1717b111-888b-4435-9161-0a4a6009640f tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:28.432145 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-1717b111-888b-4435-9161-0a4a6009640f tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:28.435543 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-91b5d937-ba9f-4fb4-a650-2bf3fd808447 req-d576a18b-88d0-4156-b295-1ad38d63e5a6 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:28.435996 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-91b5d937-ba9f-4fb4-a650-2bf3fd808447 req-d576a18b-88d0-4156-b295-1ad38d63e5a6 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:28.450496 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-91b5d937-ba9f-4fb4-a650-2bf3fd808447 req-d576a18b-88d0-4156-b295-1ad38d63e5a6 service nova] Creating event network-changed:4b6ff525-fca0-4b4b-84ff-4dd46b564360 for instance 0522ba64-2fed-48a8-ae58-bc6e27070550 on hv-cinder-85083 Jul 25 06:14:28.457458 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-91b5d937-ba9f-4fb4-a650-2bf3fd808447 req-d576a18b-88d0-4156-b295-1ad38d63e5a6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035207 Jul 25 06:14:28.458406 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 639/1252] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:14:28.459488 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-1717b111-888b-4435-9161-0a4a6009640f tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Going to try to terminate instance {{(pid=130162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:14:28.769055 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-1717b111-888b-4435-9161-0a4a6009640f tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 204 len: 0 microversion: 2.1 time: 0.347298 Jul 25 06:14:28.769055 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 614/1253] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:14:28 2022] DELETE /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:14:28.775936 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-2efb1e05-5975-415f-90ab-8cbd86d60a41 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:28.776780 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-2efb1e05-5975-415f-90ab-8cbd86d60a41 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:28.783410 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2efb1e05-5975-415f-90ab-8cbd86d60a41 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:28.784112 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2efb1e05-5975-415f-90ab-8cbd86d60a41 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:28.784892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2efb1e05-5975-415f-90ab-8cbd86d60a41 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:28.785330 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-2efb1e05-5975-415f-90ab-8cbd86d60a41 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:28.960534 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.policy [None req-2efb1e05-5975-415f-90ab-8cbd86d60a41 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130163) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:14:28.968408 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-2efb1e05-5975-415f-90ab-8cbd86d60a41 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1578 microversion: 2.1 time: 0.196668 Jul 25 06:14:28.968982 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 640/1254] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:14:28 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1578 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:14:29.987074 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-4950abbc-9e3a-4107-8070-3ec6ad9b9452 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:29.987787 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-4950abbc-9e3a-4107-8070-3ec6ad9b9452 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:29.994198 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4950abbc-9e3a-4107-8070-3ec6ad9b9452 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:29.994683 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4950abbc-9e3a-4107-8070-3ec6ad9b9452 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:29.995438 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4950abbc-9e3a-4107-8070-3ec6ad9b9452 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:29.995870 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-4950abbc-9e3a-4107-8070-3ec6ad9b9452 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:30.129033 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-4950abbc-9e3a-4107-8070-3ec6ad9b9452 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:14:30.137216 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-4950abbc-9e3a-4107-8070-3ec6ad9b9452 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1578 microversion: 2.1 time: 0.154384 Jul 25 06:14:30.137803 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 615/1255] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:14:29 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:14:30.820052 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [req-3628d7cc-2200-45c5-b3e7-8dcd294b1eb5 req-372dcb7e-62f1-4502-81a3-d9c47aad4556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0522ba64-2fed-48a8-ae58-bc6e27070550", "name": "network-vif-deleted", "tag": "4b6ff525-fca0-4b4b-84ff-4dd46b564360"}]} {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:14:30.828666 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-3628d7cc-2200-45c5-b3e7-8dcd294b1eb5 req-372dcb7e-62f1-4502-81a3-d9c47aad4556 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:30.829139 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [req-3628d7cc-2200-45c5-b3e7-8dcd294b1eb5 req-372dcb7e-62f1-4502-81a3-d9c47aad4556 service nova] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:30.840153 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.compute.server_external_events [req-3628d7cc-2200-45c5-b3e7-8dcd294b1eb5 req-372dcb7e-62f1-4502-81a3-d9c47aad4556 service nova] Creating event network-vif-deleted:4b6ff525-fca0-4b4b-84ff-4dd46b564360 for instance 0522ba64-2fed-48a8-ae58-bc6e27070550 on hv-cinder-85083 Jul 25 06:14:30.844996 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [req-3628d7cc-2200-45c5-b3e7-8dcd294b1eb5 req-372dcb7e-62f1-4502-81a3-d9c47aad4556 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028606 Jul 25 06:14:30.845587 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 641/1256] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 06:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:14:31.159554 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-d07fc119-8aa5-4971-baaf-17f27806b462 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:31.160855 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-d07fc119-8aa5-4971-baaf-17f27806b462 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:31.169294 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d07fc119-8aa5-4971-baaf-17f27806b462 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:31.169783 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d07fc119-8aa5-4971-baaf-17f27806b462 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:31.170545 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d07fc119-8aa5-4971-baaf-17f27806b462 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:31.170545 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-d07fc119-8aa5-4971-baaf-17f27806b462 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:31.264815 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.policy [None req-d07fc119-8aa5-4971-baaf-17f27806b462 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8650e8e864f045c59cf38e7a50949b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eef98733468492383e255f9045cd025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130162) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:14:31.267941 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-d07fc119-8aa5-4971-baaf-17f27806b462 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 200 len: 1225 microversion: 2.1 time: 0.116222 Jul 25 06:14:31.274957 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 616/1257] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:14:31 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 1225 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:14:32.287363 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-18a5f4b7-5420-4cc0-80fa-99d55b9f26bb tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:32.288070 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-18a5f4b7-5420-4cc0-80fa-99d55b9f26bb tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 0522ba64-2fed-48a8-ae58-bc6e27070550] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:32.294388 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-18a5f4b7-5420-4cc0-80fa-99d55b9f26bb tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:32.294897 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-18a5f4b7-5420-4cc0-80fa-99d55b9f26bb tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:32.295643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-18a5f4b7-5420-4cc0-80fa-99d55b9f26bb tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:32.296079 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-18a5f4b7-5420-4cc0-80fa-99d55b9f26bb tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:32.313165 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-18a5f4b7-5420-4cc0-80fa-99d55b9f26bb tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] HTTP exception thrown: Instance 0522ba64-2fed-48a8-ae58-bc6e27070550 could not be found. Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-18a5f4b7-5420-4cc0-80fa-99d55b9f26bb tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Request method failure captured: Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 HTTP/1.1 Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jMpe7uIwLmg-YgfkJNhFTDfzN8JLVgbMV0lio3YmXOtTQ4ILmM1ZsfBjQR7_JTQRMScC8rfEfWzjxDH6R4vI7QiD4QwsSvFN5WWtxkHlyjOfSk0SOuEKTKZZVC8kIT1nPBjlAA54ha6aRm2LnqXVYV95FWHgiCfQePkvedjr-dI6M4 Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 5eef98733468492383e255f9045cd025 Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-TestVolumeBootPattern-75221817 Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:14:32.314892 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:14:32.316648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5eef98733468492383e255f9045cd025"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5eef98733468492383e255f9045cd025"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5eef98733468492383e255f9045cd025"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5eef98733468492383e255f9045cd025", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:14:32.316648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-TestVolumeBootPattern-75221817 Jul 25 06:14:32.316648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 5eef98733468492383e255f9045cd025 Jul 25 06:14:32.316648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-TestVolumeBootPattern-75221817 Jul 25 06:14:32.316648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-TestVolumeBootPattern-75221817-project Jul 25 06:14:32.316648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:14:32.316648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:14:32.316648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 8650e8e864f045c59cf38e7a50949b94 Jul 25 06:14:32.316648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-TestVolumeBootPattern-75221817-project Jul 25 06:14:32.316648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:14:32.316648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 0522ba64-2fed-48a8-ae58-bc6e27070550 could not be found. Jul 25 06:14:32.316648 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '0522ba64-2fed-48a8-ae58-bc6e27070550'} Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0522ba64-2fed-48a8-ae58-bc6e27070550 could not be found. Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:14:32.317771 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0522ba64-2fed-48a8-ae58-bc6e27070550 could not be found. Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0522ba64-2fed-48a8-ae58-bc6e27070550 could not be found. Jul 25 06:14:32.319757 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:14:32.328187 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-18a5f4b7-5420-4cc0-80fa-99d55b9f26bb tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Returning 404 to user: Instance 0522ba64-2fed-48a8-ae58-bc6e27070550 could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:14:32.328187 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-18a5f4b7-5420-4cc0-80fa-99d55b9f26bb tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550" status: 404 len: 111 microversion: 2.1 time: 0.034278 Jul 25 06:14:32.328187 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 642/1258] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:14:32 2022] GET /compute/v2.1/servers/0522ba64-2fed-48a8-ae58-bc6e27070550 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 06:14:33.095836 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a12034d8-97f8-4975-93fa-ec11dd6276b9 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:33.096883 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.compute.api [None req-a12034d8-97f8-4975-93fa-ec11dd6276b9 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130162) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:33.103524 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a12034d8-97f8-4975-93fa-ec11dd6276b9 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:33.103967 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a12034d8-97f8-4975-93fa-ec11dd6276b9 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:33.104721 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a12034d8-97f8-4975-93fa-ec11dd6276b9 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:33.105153 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG oslo_concurrency.lockutils [None req-a12034d8-97f8-4975-93fa-ec11dd6276b9 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:33.118858 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.wsgi [None req-a12034d8-97f8-4975-93fa-ec11dd6276b9 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] HTTP exception thrown: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a12034d8-97f8-4975-93fa-ec11dd6276b9 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Request method failure captured: Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: request: DELETE /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 HTTP/1.1 Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept: application/json Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Accept-Encoding: identity Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Connection: close Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Length: 0 Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Content-Type: application/json Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Host: 10.222.0.17 Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Openstack-System-Scope: None Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: User-Agent: python-urllib3/1.26.9 Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Auth-Token: gAAAAABi3jMpe7uIwLmg-YgfkJNhFTDfzN8JLVgbMV0lio3YmXOtTQ4ILmM1ZsfBjQR7_JTQRMScC8rfEfWzjxDH6R4vI7QiD4QwsSvFN5WWtxkHlyjOfSk0SOuEKTKZZVC8kIT1nPBjlAA54ha6aRm2LnqXVYV95FWHgiCfQePkvedjr-dI6M4 Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Id: None Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Domain-Name: None Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Identity-Status: Confirmed Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Is-Admin-Project: True Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Id: default Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Domain-Name: Default Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Id: 5eef98733468492383e255f9045cd025 Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Project-Name: tempest-TestVolumeBootPattern-75221817 Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Role: reader,member Jul 25 06:14:33.120520 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Roles: reader,member Jul 25 06:14:33.122028 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5eef98733468492383e255f9045cd025"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5eef98733468492383e255f9045cd025"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5eef98733468492383e255f9045cd025"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5eef98733468492383e255f9045cd025", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:14:33.122028 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant: tempest-TestVolumeBootPattern-75221817 Jul 25 06:14:33.122028 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Id: 5eef98733468492383e255f9045cd025 Jul 25 06:14:33.122028 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-Tenant-Name: tempest-TestVolumeBootPattern-75221817 Jul 25 06:14:33.122028 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User: tempest-TestVolumeBootPattern-75221817-project Jul 25 06:14:33.122028 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Id: default Jul 25 06:14:33.122028 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Domain-Name: Default Jul 25 06:14:33.122028 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Id: 8650e8e864f045c59cf38e7a50949b94 Jul 25 06:14:33.122028 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: X-User-Name: tempest-TestVolumeBootPattern-75221817-project Jul 25 06:14:33.122028 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: method: > Jul 25 06:14:33.122028 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: exception: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. Jul 25 06:14:33.122028 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: action_args: {'id': '7934824b-229d-4bb6-a229-f071b9338837'} Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:14:33.124794 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. Jul 25 06:14:33.126517 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: ERROR nova.api.openstack.wsgi Jul 25 06:14:33.128079 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-a12034d8-97f8-4975-93fa-ec11dd6276b9 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Returning 404 to user: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. {{(pid=130162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:14:33.128079 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-a12034d8-97f8-4975-93fa-ec11dd6276b9 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 404 len: 111 microversion: 2.1 time: 0.029981 Jul 25 06:14:33.128079 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 617/1259] 10.222.0.17 () {58 vars in 1238 bytes} [Mon Jul 25 06:14:33 2022] DELETE /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:14:33.132541 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3ee31b9d-10f1-4ef7-bcd3-11cd8f274277 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '>' {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:33.133170 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.compute.api [None req-3ee31b9d-10f1-4ef7-bcd3-11cd8f274277 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] [instance: 7934824b-229d-4bb6-a229-f071b9338837] Fetching instance by UUID {{(pid=130163) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:33.139244 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3ee31b9d-10f1-4ef7-bcd3-11cd8f274277 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:33.139692 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3ee31b9d-10f1-4ef7-bcd3-11cd8f274277 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:33.140453 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3ee31b9d-10f1-4ef7-bcd3-11cd8f274277 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:33.140883 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG oslo_concurrency.lockutils [None req-3ee31b9d-10f1-4ef7-bcd3-11cd8f274277 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Lock "e96e4b7c-deb5-4a1c-b19f-218c15ae3652" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:33.156139 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.wsgi [None req-3ee31b9d-10f1-4ef7-bcd3-11cd8f274277 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] HTTP exception thrown: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3ee31b9d-10f1-4ef7-bcd3-11cd8f274277 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Request method failure captured: Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: request: GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 HTTP/1.1 Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept: application/json Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Accept-Encoding: identity Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Connection: close Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Length: 0 Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Content-Type: application/json Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Host: 10.222.0.17 Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Openstack-System-Scope: None Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: User-Agent: python-urllib3/1.26.9 Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Auth-Token: gAAAAABi3jMpe7uIwLmg-YgfkJNhFTDfzN8JLVgbMV0lio3YmXOtTQ4ILmM1ZsfBjQR7_JTQRMScC8rfEfWzjxDH6R4vI7QiD4QwsSvFN5WWtxkHlyjOfSk0SOuEKTKZZVC8kIT1nPBjlAA54ha6aRm2LnqXVYV95FWHgiCfQePkvedjr-dI6M4 Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Id: None Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Domain-Name: None Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Identity-Status: Confirmed Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Is-Admin-Project: True Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Id: default Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Domain-Name: Default Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Id: 5eef98733468492383e255f9045cd025 Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Project-Name: tempest-TestVolumeBootPattern-75221817 Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Role: reader,member Jul 25 06:14:33.157643 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Roles: reader,member Jul 25 06:14:33.159497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5eef98733468492383e255f9045cd025"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5eef98733468492383e255f9045cd025"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5eef98733468492383e255f9045cd025"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5eef98733468492383e255f9045cd025", "adminURL": "http://10.222.0.17:8080"}]}] Jul 25 06:14:33.159497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant: tempest-TestVolumeBootPattern-75221817 Jul 25 06:14:33.159497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Id: 5eef98733468492383e255f9045cd025 Jul 25 06:14:33.159497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-Tenant-Name: tempest-TestVolumeBootPattern-75221817 Jul 25 06:14:33.159497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User: tempest-TestVolumeBootPattern-75221817-project Jul 25 06:14:33.159497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Id: default Jul 25 06:14:33.159497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Domain-Name: Default Jul 25 06:14:33.159497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Id: 8650e8e864f045c59cf38e7a50949b94 Jul 25 06:14:33.159497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: X-User-Name: tempest-TestVolumeBootPattern-75221817-project Jul 25 06:14:33.159497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: method: > Jul 25 06:14:33.159497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: exception: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. Jul 25 06:14:33.159497 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: action_args: {'id': '7934824b-229d-4bb6-a229-f071b9338837'} Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: {{(pid=130163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:14:33.160385 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. Jul 25 06:14:33.161766 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: ERROR nova.api.openstack.wsgi Jul 25 06:14:33.163152 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: DEBUG nova.api.openstack.wsgi [None req-3ee31b9d-10f1-4ef7-bcd3-11cd8f274277 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Returning 404 to user: Instance 7934824b-229d-4bb6-a229-f071b9338837 could not be found. {{(pid=130163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:14:33.163152 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO nova.api.openstack.requestlog [None req-3ee31b9d-10f1-4ef7-bcd3-11cd8f274277 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837" status: 404 len: 111 microversion: 2.1 time: 0.032201 Jul 25 06:14:33.163152 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: [pid: 130163|app: 0|req: 643/1260] 10.222.0.17 () {58 vars in 1235 bytes} [Mon Jul 25 06:14:33 2022] GET /compute/v2.1/servers/7934824b-229d-4bb6-a229-f071b9338837 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:14:34.686043 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: DEBUG nova.api.openstack.wsgi [None req-26b4897f-31a6-46e5-b34b-3ce6027cf822 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] Calling method '.version_select at 0x7f9d36a5f430>' {{(pid=130162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:34.802736 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO nova.api.openstack.requestlog [None req-26b4897f-31a6-46e5-b34b-3ce6027cf822 tempest-TestVolumeBootPattern-75221817 tempest-TestVolumeBootPattern-75221817-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1541654995" status: 202 len: 0 microversion: 2.1 time: 0.120397 Jul 25 06:14:34.803324 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: [pid: 130162|app: 0|req: 618/1261] 10.222.0.17 () {58 vars in 1262 bytes} [Mon Jul 25 06:14:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1541654995 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:15:31.317451 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:15:31.318051 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Mon Jul 25 06:15:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:15:33.570496 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:15:33.571559 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Mon Jul 25 06:15:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:15:37.717980 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:15:37.718550 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Mon Jul 25 06:15:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:17:22.558764 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:17:22.559401 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Mon Jul 25 06:17:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:17:31.304003 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:17:31.305026 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Mon Jul 25 06:17:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:17:33.404972 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:17:33.405521 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Mon Jul 25 06:17:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:18:51.327125 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:18:51.327720 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Mon Jul 25 06:18:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:18:53.579159 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:18:53.579786 dv-cinder-850831-1-iscsi devstack@n-api.service[130162]: Mon Jul 25 06:18:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:18:57.726216 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:18:57.726807 dv-cinder-850831-1-iscsi devstack@n-api.service[130163]: Mon Jul 25 06:18:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!